{"id":273,"date":"2009-11-05T15:59:40","date_gmt":"2009-11-05T15:59:40","guid":{"rendered":"https:\/\/wade.one\/blog\/?p=273"},"modified":"2009-11-05T15:59:40","modified_gmt":"2009-11-05T15:59:40","slug":"link-checker-update-download-meta-data-errors-redirects-as-csv","status":"publish","type":"post","link":"https:\/\/wade.one\/blog\/2009\/11\/05\/link-checker-update-download-meta-data-errors-redirects-as-csv\/","title":{"rendered":"Link Checker Update &#8211; Download Meta Data, Errors, Redirects as CSV"},"content":{"rendered":"<p>I&#8217;ve updated my Link Checker (site crawler) located at <a href=\"https:\/\/wade.one\/tools\/linkchecker\" target=\"_blank\">https:\/\/wade.one\/tools\/linkchecker<\/a> to allow downloading of the data it finds as CSV files. So all redirect URL&#8217;s, 404&#8217;s and meta data for all pages can be downloaded.<\/p>\n<p>The links are at the bottom of the page after the initial output of data.<\/p>\n<p><a href=\"https:\/\/wade.one\/tools\/linkchecker\" target=\"_blank\">Use the Link Checker here<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I&#8217;ve updated my Link Checker (site crawler) located at https:\/\/wade.one\/tools\/linkchecker to allow downloading of the data it finds as CSV files. So all redirect URL&#8217;s, 404&#8217;s and meta data for all pages can be downloaded. The links are at the bottom of the page after the initial output of data. Use the Link Checker here.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[11,13,16],"tags":[],"class_list":["post-273","post","type-post","status-publish","format-standard","hentry","category-news","category-programming","category-seo"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Link Checker Update - Download Meta Data, Errors, Redirects as CSV - wade.one<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/wade.one\/blog\/2009\/11\/05\/link-checker-update-download-meta-data-errors-redirects-as-csv\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Link Checker Update - Download Meta Data, Errors, Redirects as CSV - wade.one\" \/>\n<meta property=\"og:description\" content=\"I&#8217;ve updated my Link Checker (site crawler) located at https:\/\/wade.one\/tools\/linkchecker to allow downloading of the data it finds as CSV files. So all redirect URL&#8217;s, 404&#8217;s and meta data for all pages can be downloaded. The links are at the bottom of the page after the initial output of data. Use the Link Checker here.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/wade.one\/blog\/2009\/11\/05\/link-checker-update-download-meta-data-errors-redirects-as-csv\/\" \/>\n<meta property=\"og:site_name\" content=\"wade.one\" \/>\n<meta property=\"article:published_time\" content=\"2009-11-05T15:59:40+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/wade.one\/blog\/wp-content\/uploads\/2015\/02\/Wade-Logo-cropped.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1518\" \/>\n\t<meta property=\"og:image:height\" content=\"1506\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Wade\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@wadewomersley\" \/>\n<meta name=\"twitter:site\" content=\"@wadewomersley\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Wade\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/wade.one\\\/blog\\\/2009\\\/11\\\/05\\\/link-checker-update-download-meta-data-errors-redirects-as-csv\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/wade.one\\\/blog\\\/2009\\\/11\\\/05\\\/link-checker-update-download-meta-data-errors-redirects-as-csv\\\/\"},\"author\":{\"name\":\"Wade\",\"@id\":\"https:\\\/\\\/wade.one\\\/blog\\\/#\\\/schema\\\/person\\\/f9dedd948575256e77a44aa1417f63de\"},\"headline\":\"Link Checker Update &#8211; Download Meta Data, Errors, Redirects as CSV\",\"datePublished\":\"2009-11-05T15:59:40+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/wade.one\\\/blog\\\/2009\\\/11\\\/05\\\/link-checker-update-download-meta-data-errors-redirects-as-csv\\\/\"},\"wordCount\":72,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/wade.one\\\/blog\\\/#\\\/schema\\\/person\\\/8b4739f8f8bb2cff5d792d4b8779fcc3\"},\"articleSection\":[\"News\",\"Programming\",\"SEO\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/wade.one\\\/blog\\\/2009\\\/11\\\/05\\\/link-checker-update-download-meta-data-errors-redirects-as-csv\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/wade.one\\\/blog\\\/2009\\\/11\\\/05\\\/link-checker-update-download-meta-data-errors-redirects-as-csv\\\/\",\"url\":\"https:\\\/\\\/wade.one\\\/blog\\\/2009\\\/11\\\/05\\\/link-checker-update-download-meta-data-errors-redirects-as-csv\\\/\",\"name\":\"Link Checker Update - Download Meta Data, Errors, Redirects as CSV - wade.one\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/wade.one\\\/blog\\\/#website\"},\"datePublished\":\"2009-11-05T15:59:40+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/wade.one\\\/blog\\\/2009\\\/11\\\/05\\\/link-checker-update-download-meta-data-errors-redirects-as-csv\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/wade.one\\\/blog\\\/2009\\\/11\\\/05\\\/link-checker-update-download-meta-data-errors-redirects-as-csv\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/wade.one\\\/blog\\\/2009\\\/11\\\/05\\\/link-checker-update-download-meta-data-errors-redirects-as-csv\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/wade.one\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Link Checker Update &#8211; Download Meta Data, Errors, Redirects as CSV\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/wade.one\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/wade.one\\\/blog\\\/\",\"name\":\"wade.one\",\"description\":\"wade womersley - york based software engineer\",\"publisher\":{\"@id\":\"https:\\\/\\\/wade.one\\\/blog\\\/#\\\/schema\\\/person\\\/8b4739f8f8bb2cff5d792d4b8779fcc3\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/wade.one\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":[\"Person\",\"Organization\"],\"@id\":\"https:\\\/\\\/wade.one\\\/blog\\\/#\\\/schema\\\/person\\\/8b4739f8f8bb2cff5d792d4b8779fcc3\",\"name\":\"Wade Womersley\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/wade.one\\\/blog\\\/wp-content\\\/uploads\\\/2015\\\/02\\\/200px.png\",\"url\":\"https:\\\/\\\/wade.one\\\/blog\\\/wp-content\\\/uploads\\\/2015\\\/02\\\/200px.png\",\"contentUrl\":\"https:\\\/\\\/wade.one\\\/blog\\\/wp-content\\\/uploads\\\/2015\\\/02\\\/200px.png\",\"width\":202,\"height\":200,\"caption\":\"Wade Womersley\"},\"logo\":{\"@id\":\"https:\\\/\\\/wade.one\\\/blog\\\/wp-content\\\/uploads\\\/2015\\\/02\\\/200px.png\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/wade.one\\\/blog\\\/#\\\/schema\\\/person\\\/f9dedd948575256e77a44aa1417f63de\",\"name\":\"Wade\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/94100ef7361b8aaac136b852c8df93bdd10942165a122d5c56e4466cc403e5d9?s=96&d=retro&r=pg\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/94100ef7361b8aaac136b852c8df93bdd10942165a122d5c56e4466cc403e5d9?s=96&d=retro&r=pg\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/94100ef7361b8aaac136b852c8df93bdd10942165a122d5c56e4466cc403e5d9?s=96&d=retro&r=pg\",\"caption\":\"Wade\"},\"url\":\"https:\\\/\\\/wade.one\\\/blog\\\/author\\\/wade\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Link Checker Update - Download Meta Data, Errors, Redirects as CSV - wade.one","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/wade.one\/blog\/2009\/11\/05\/link-checker-update-download-meta-data-errors-redirects-as-csv\/","og_locale":"en_GB","og_type":"article","og_title":"Link Checker Update - Download Meta Data, Errors, Redirects as CSV - wade.one","og_description":"I&#8217;ve updated my Link Checker (site crawler) located at https:\/\/wade.one\/tools\/linkchecker to allow downloading of the data it finds as CSV files. So all redirect URL&#8217;s, 404&#8217;s and meta data for all pages can be downloaded. The links are at the bottom of the page after the initial output of data. Use the Link Checker here.","og_url":"https:\/\/wade.one\/blog\/2009\/11\/05\/link-checker-update-download-meta-data-errors-redirects-as-csv\/","og_site_name":"wade.one","article_published_time":"2009-11-05T15:59:40+00:00","og_image":[{"width":1518,"height":1506,"url":"https:\/\/wade.one\/blog\/wp-content\/uploads\/2015\/02\/Wade-Logo-cropped.png","type":"image\/png"}],"author":"Wade","twitter_card":"summary_large_image","twitter_creator":"@wadewomersley","twitter_site":"@wadewomersley","twitter_misc":{"Written by":"Wade"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/wade.one\/blog\/2009\/11\/05\/link-checker-update-download-meta-data-errors-redirects-as-csv\/#article","isPartOf":{"@id":"https:\/\/wade.one\/blog\/2009\/11\/05\/link-checker-update-download-meta-data-errors-redirects-as-csv\/"},"author":{"name":"Wade","@id":"https:\/\/wade.one\/blog\/#\/schema\/person\/f9dedd948575256e77a44aa1417f63de"},"headline":"Link Checker Update &#8211; Download Meta Data, Errors, Redirects as CSV","datePublished":"2009-11-05T15:59:40+00:00","mainEntityOfPage":{"@id":"https:\/\/wade.one\/blog\/2009\/11\/05\/link-checker-update-download-meta-data-errors-redirects-as-csv\/"},"wordCount":72,"commentCount":0,"publisher":{"@id":"https:\/\/wade.one\/blog\/#\/schema\/person\/8b4739f8f8bb2cff5d792d4b8779fcc3"},"articleSection":["News","Programming","SEO"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/wade.one\/blog\/2009\/11\/05\/link-checker-update-download-meta-data-errors-redirects-as-csv\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/wade.one\/blog\/2009\/11\/05\/link-checker-update-download-meta-data-errors-redirects-as-csv\/","url":"https:\/\/wade.one\/blog\/2009\/11\/05\/link-checker-update-download-meta-data-errors-redirects-as-csv\/","name":"Link Checker Update - Download Meta Data, Errors, Redirects as CSV - wade.one","isPartOf":{"@id":"https:\/\/wade.one\/blog\/#website"},"datePublished":"2009-11-05T15:59:40+00:00","breadcrumb":{"@id":"https:\/\/wade.one\/blog\/2009\/11\/05\/link-checker-update-download-meta-data-errors-redirects-as-csv\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/wade.one\/blog\/2009\/11\/05\/link-checker-update-download-meta-data-errors-redirects-as-csv\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/wade.one\/blog\/2009\/11\/05\/link-checker-update-download-meta-data-errors-redirects-as-csv\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/wade.one\/blog\/"},{"@type":"ListItem","position":2,"name":"Link Checker Update &#8211; Download Meta Data, Errors, Redirects as CSV"}]},{"@type":"WebSite","@id":"https:\/\/wade.one\/blog\/#website","url":"https:\/\/wade.one\/blog\/","name":"wade.one","description":"wade womersley - york based software engineer","publisher":{"@id":"https:\/\/wade.one\/blog\/#\/schema\/person\/8b4739f8f8bb2cff5d792d4b8779fcc3"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/wade.one\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":["Person","Organization"],"@id":"https:\/\/wade.one\/blog\/#\/schema\/person\/8b4739f8f8bb2cff5d792d4b8779fcc3","name":"Wade Womersley","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/wade.one\/blog\/wp-content\/uploads\/2015\/02\/200px.png","url":"https:\/\/wade.one\/blog\/wp-content\/uploads\/2015\/02\/200px.png","contentUrl":"https:\/\/wade.one\/blog\/wp-content\/uploads\/2015\/02\/200px.png","width":202,"height":200,"caption":"Wade Womersley"},"logo":{"@id":"https:\/\/wade.one\/blog\/wp-content\/uploads\/2015\/02\/200px.png"}},{"@type":"Person","@id":"https:\/\/wade.one\/blog\/#\/schema\/person\/f9dedd948575256e77a44aa1417f63de","name":"Wade","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/secure.gravatar.com\/avatar\/94100ef7361b8aaac136b852c8df93bdd10942165a122d5c56e4466cc403e5d9?s=96&d=retro&r=pg","url":"https:\/\/secure.gravatar.com\/avatar\/94100ef7361b8aaac136b852c8df93bdd10942165a122d5c56e4466cc403e5d9?s=96&d=retro&r=pg","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/94100ef7361b8aaac136b852c8df93bdd10942165a122d5c56e4466cc403e5d9?s=96&d=retro&r=pg","caption":"Wade"},"url":"https:\/\/wade.one\/blog\/author\/wade\/"}]}},"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":240,"url":"https:\/\/wade.one\/blog\/2009\/10\/22\/link-checker-free-tool-launched-on-site\/","url_meta":{"origin":273,"position":0},"title":"Link Checker &#8211; Free Tool Launched on Site","author":"Wade","date":"October 22, 2009","format":false,"excerpt":"I've just finished writing version one of my link checker tool and have now launched it on my site. The tool will parse a given\u00a0 URL, extract all links on that page that point to the same domain and follow them, and keep doing that until it's finished. It will\u2026","rel":"","context":"In &quot;News&quot;","block_context":{"text":"News","link":"https:\/\/wade.one\/blog\/category\/news\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1177,"url":"https:\/\/wade.one\/blog\/2026\/04\/09\/offline-support-sounds-smaller-than-it-is\/","url_meta":{"origin":273,"position":1},"title":"Offline Support Sounds Smaller Than It Is","author":"Wade","date":"April 9, 2026","format":false,"excerpt":"Offline support looks like a simple feature request until you have to deal with stale data, sync conflicts, retry rules, and user expectations. The hard part is not storing data locally. It is keeping the whole system honest.","rel":"","context":"In &quot;Programming&quot;","block_context":{"text":"Programming","link":"https:\/\/wade.one\/blog\/category\/programming\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":644,"url":"https:\/\/wade.one\/blog\/2013\/06\/23\/cloudants-rather-awesome-dbcopy-for-re-reducing-the-output-of-existing-mapreduce-data\/","url_meta":{"origin":273,"position":2},"title":"Cloudant&#8217;s Rather Awesome dbcopy for re-reducing the output of existing map\/reduce data.","author":"Wade","date":"June 23, 2013","format":false,"excerpt":"I love Cloudant, simple as, their implementation of CouchDB as a DDaaS (as opposed to DBaaS) has no real competitor - as CouchDB develop's, that may, of course, become a problem as it gives dominance in a market, but for now, we're good. One of their best features is the\u2026","rel":"","context":"In &quot;Programming&quot;","block_context":{"text":"Programming","link":"https:\/\/wade.one\/blog\/category\/programming\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1115,"url":"https:\/\/wade.one\/blog\/2023\/03\/26\/mongodb-vs-documentdb\/","url_meta":{"origin":273,"position":3},"title":"MongoDB vs DocumentDB","author":"Wade","date":"March 26, 2023","format":false,"excerpt":"I've been working on a new as-fast-as-possible platform for a specific situation I can't go in to right now but I wanted to use MongoDB, however, I needed to reduce costs and use AWS so I wanted to use DocumentDB and needed to compare. Sadly DocumentDB does not cover 100%\u2026","rel":"","context":"In &quot;Programming&quot;","block_context":{"text":"Programming","link":"https:\/\/wade.one\/blog\/category\/programming\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1118,"url":"https:\/\/wade.one\/blog\/2023\/03\/26\/expanding-on-performance-of-redis-vs-mongodb-for-a-push-pull-system\/","url_meta":{"origin":273,"position":4},"title":"Expanding on performance of Redis vs MongoDB for a push\/pull system","author":"Wade","date":"March 26, 2023","format":false,"excerpt":"When it comes to building a push\/pop system, both Redis and MongoDB can be used as effective solutions. However, there are a few key differences between these two databases that can impact which one you choose for your system. Redis is an in-memory data structure store that can be used\u2026","rel":"","context":"In &quot;PHP&quot;","block_context":{"text":"PHP","link":"https:\/\/wade.one\/blog\/category\/php\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":431,"url":"https:\/\/wade.one\/blog\/2010\/01\/29\/mysql-binary16-and-scalability\/","url_meta":{"origin":273,"position":5},"title":"MySQL &#8211; Binary(16) and scalability","author":"Wade","date":"January 29, 2010","format":false,"excerpt":"Over the past few months at work, we've seen our database grown from silly big to really silly big, it's still a way to go to get to the size of the big boys such as Facebook etc. but it's still a database stored in MySQL that most day-to-day PHP\u2026","rel":"","context":"In &quot;Programming&quot;","block_context":{"text":"Programming","link":"https:\/\/wade.one\/blog\/category\/programming\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/wade.one\/blog\/wp-json\/wp\/v2\/posts\/273","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wade.one\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wade.one\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wade.one\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/wade.one\/blog\/wp-json\/wp\/v2\/comments?post=273"}],"version-history":[{"count":0,"href":"https:\/\/wade.one\/blog\/wp-json\/wp\/v2\/posts\/273\/revisions"}],"wp:attachment":[{"href":"https:\/\/wade.one\/blog\/wp-json\/wp\/v2\/media?parent=273"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wade.one\/blog\/wp-json\/wp\/v2\/categories?post=273"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wade.one\/blog\/wp-json\/wp\/v2\/tags?post=273"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}