apt/methods/rred.cc, branch 1.2.1

allow pdiff bootstrap from all supported compressors

2016-01-08T14:40:01Z

There is no reason to enforce that the file we start the bootstrap with is compressed with a compressor which is available online. This allows us to change the on-disk format as well as deals with repositories adding/removing support for a specific compressor.

rred: Run in parallel

2016-01-07T16:32:39Z

Remove the SingleInstance flag so we can use the new randomized queue feature to run parallel.

rred: Use buffered writes

2015-12-27T15:23:32Z

Buffered writes improve performance a lot, given that we spent about 78% of the time in _write.

rred: Only call pkgInitConfig() in test mode

2015-12-27T12:25:23Z

This accidentally slipped in in a previous commit, but it should be used only for testing mode. Reported-By: David Kalnischkies

Convert most callers of isspace() to isspace_ascii()

2015-12-27T00:20:41Z

This converts all callers that read machine-generated data, callers that might work with user input are not converted.

rred: Allow passing files as arguments for compressor testing

2015-12-26T14:29:00Z

This introduces a -t mode in which the first argument is input, the second is output and the remaining are diffs. This allows us to test patching compressed files, which are detected using their file extension.

apply various suggestions made by cppcheck

2015-11-05T11:21:33Z

Reported-By: cppcheck Git-Dch: Ignore

allow acquire method specific options via Binary scope

2015-11-05T11:21:33Z

Allows users who know what they are getting themselves into with this trick to e.g. disable privilege dropping for e.g. file:// until they can fix up the permissions on those repositories. It helps also the test framework and people with a similar setup (= me) to run in less modified environments.

avoid using global PendingError to avoid failing too often too soon

2015-09-14T13:22:18Z

Our error reporting is historically grown into some kind of mess. A while ago I implemented stacking for the global error which is used in this commit now to wrap calls to functions which do not report (all) errors via return, so that only failures in those calls cause a failure to propergate down the chain rather than failing if anything (potentially totally unrelated) has failed at some point in the past. This way we can avoid stopping the entire acquire process just because a single source produced an error for example. It also means that after the acquire process the cache is generated – even if the acquire process had failures – as we still have the old good data around we can and should generate a cache for (again). There are probably more instances of this hiding, but all these looked like the easiest to work with and fix with reasonable (aka net-positive) effects.

implement PDiff patching for compressed files

2015-08-28T17:26:44Z

Some additional files like 'Contents' are very big and should therefore kept compressed on the disk, which apt-file did in the past. It also implemented pdiff patching of these files by un- and recompressing these files on-the-fly, with this commit we can do the same – but we can do this in both pdiff patching styles (client and server merging) and secured by hashes. Hashes are in so far slightly complicated as we can't compare the hashes of the compressed files as we might compress them differently than the server would (different compressor versions, options, …), so we must compare the hashes of the uncompressed content. While this commit has changes in public headers, the classes it changes are marked as hidden, so nobody can use them directly, which means the ABI break is internal only.