The following are changes currently implemented in development builds of Cyotek WebCopy. Please note that these changes are not final and may be removed prior to the next stable release. If you have any comments about these forthcoming changes, please contact us.

Nightly builds featuring these changes are available from the Downloads page.

Warning! WebCopy projects saved using 1.8 are not backwards-compatible with older versions of WebCopy

Added

  • Link Checker GUI client now allows the checking of external links to be enabled or disabled
  • Link Checker GUI client now allows if URLs belonging to parent, sibling or sub domains should be checked
  • Added auto scroll option to Link Checker GUI client
  • Added progress indicator to Link Checker GUI client
  • Added new Use Recycle Bin option to project settings. If set and the Empty website folder before copy is also set, any deleted files will be moved to the Recycle Bin instead
  • The View Links dialog now allows the display of excluded URLs to be toggled
  • Added proper editor for defining web page language settings at the project level
  • Add application level setting for definition web page language settings

Changed

  • WebCopy will now prompt to continue if the Empty website folder before copy option is set and files are present in the destination
  • The Sitemap Extension will now start from the base domain if the project URL is deep and the Crawl Above Root flag is set
  • Updated mime-db to 1.44.0
  • The GUI now displays a proper progress indicator and status information when remapping local files
  • The CLI client now displays status information when remapping files
  • The Origin Report option for new projects now defaults to Single File rather than Embedded
  • WebCopy will now always send the Accept-Language header. If not defined at the project level, it will use the application level setting. If this is not provided, then the current OS culture information will be used
  • Documentation has had a good overhaul and is in the best state it has ever been in. All help links from option dialogue boxes point where they should, and missing documentation has been added
  • Expanded default contentfilters.json used by the New Project Wizard to cover other common types
  • The Accepted Content Types field has been moved from the Advanced category into a category of its own, expanded to use the same type of edited as for the web site language

Fixed

  • WebCopy was treating any attribute value that started with javascript as unsupported
  • The sitemap tree could display duplicate URLs
  • The sitemap tree would could incorrectly display children of pages that matched a standard document pattern
  • Link Checker didn't follow internal redirects
  • WebCopy could incorrectly parse the URL from an @import at-rule if the CSS was minified and another rule contained an empty content declaration
  • The Project Diagnostics extension now ignores data URLs when performing length checks
  • Cut, Copy and Paste commands didn't work for the filter fields in list views
  • Fixed a crash that could occur when ordering the sitemap
  • Reworked HEAD support detection to be more robust
  • 401 challenges were only processed during HEAD requests
  • Fixed a performance issue running XPath queries
  • Per-URL origin reports could be overwritten if URLs different only by extension
  • The New Project Wizard no longer creates duplicate rules if content types are present in multiple pre-defined groups

Removed

  • The Report Problem Site extension is no longer bundled with Setup
  • Removed global statistics

The following changes are a sneak-peak of features that are currently being experimented with in separate branches from the core product. Due to this they are not available in nightly builds (and there is no guarantee they will be merged into the core branch).

Added

  • Crawl state persistence (pause, resume) [#165]

Changed

  • Crawling now uses breadth first when prioritising enqueued items
  • New WebCopy projects will default to enabling Brotli compression support
  • New WebCopy projects will default to saving headers
  • Major refactor of internal crawl logic, making it easier to test and to add new functionality

Fixed

  • WebCopy will now retry URLs that fail with "The server committed a protocol violation" exceptions

Download

Download current and archived versions of Cyotek WebCopy

Download

Minimum Requirements

Donate

Donate