apt/test/integration, branch 1.2_exp1Debians commandline package managerhttps://git.kalnischkies.de/apt/atom?h=1.2_exp12016-01-08T16:51:23Zremove uncompressed leftover partial file before pdiff bootstrap2016-01-08T16:51:23ZDavid Kalnischkiesdavid@kalnischkies.de2016-01-08T16:51:23Zurn:sha1:ef3c549e00b2a0487ddee0aeb70e3a29f76c2fbb
The code already deals with compressed leftovers, but forgot the
uncompressed files. The opertunity is picked to reorder this code and
add debug messages about the actions taken as well as produce such a
leftover file in the associated testcase.
use filesize of compressed pdiffs for the limit if possible2016-01-08T14:40:01ZDavid Kalnischkiesdavid@kalnischkies.de2016-01-08T14:30:05Zurn:sha1:4e6219da0dd1e68fad7db972f7ddd76598645228
With the addition of the $HASH-Download field in the .diff/Index we got
the size of the compressed patches for 'free', so if that information is
available we can use it for a more fitting calculation of the size
requirements of the patches vs. the complete file.
Note that this predicts a too small size in the transition case in which
the information isn't available for all patches, but figuring this out
would be a lot of code for practically nothing as only one update can
ever be in such a transition phase.
tests: limit autotest-functionname generation to sane characters2016-01-08T14:40:01ZDavid Kalnischkiesdavid@kalnischkies.de2016-01-08T12:08:19Zurn:sha1:896f0ae857b693782658145e16e21a3054dd5280
Some (older) versions of bash seem to be allergic to a method named
"aptautotest_grep_^apt" (note the caret). Unlikely that we are going to
write autotests for such commands so we could just skip those, but lets
instead just use "normal" characters in the names and strip the rest as
we already did with the (arguable more common) '-'.
support '-' and no parameter for stdin in apt-helper cat-file2016-01-08T14:40:01ZDavid Kalnischkiesdavid@kalnischkies.de2016-01-07T23:35:39Zurn:sha1:abec2980ef1ff051be14c26097a76b6429b3b7bc
This way it works more similar to the compressor binaries, which we
can relief in this way from their job in the test framework avoiding the
need of adding e.g. liblz4-tool to the test dependencies.
keep compressed indexes in a low-cost format2016-01-08T14:40:01ZDavid Kalnischkiesdavid@kalnischkies.de2016-01-07T19:32:09Zurn:sha1:0179cfa83cf0042235eda41db7f35c420781c63e
Downloading and storing are two different operations were different
compression types can be preferred. For downloading we provide the
choice via Acquire::CompressionTypes::Order as there is a choice to
be made between download size and speed – and limited by whats available
in the repository.
Storage on the other hand has all compressions currently supported by
apt available and to reduce runtime of tools accessing these files the
compression type should be a low-cost format in terms of decompression.
apt traditionally stores its indexes uncompressed on disk, but has
options to keep them compressed. Now that apt downloads additional files
we also deal with files which simply can't be stored uncompressed as
they are just too big (like Contents for apt-file). Traditionally they
are downloaded in a low-cost format (gz) as repositories do not provide
other formats, but there might be even lower-cost formats and for
download we could introduce higher-cost in the repositories.
Downloading an entire index potentially requires recompression to
another format, so an update takes potentially longer – but big files
are usually updated via pdiffs which has to de- and re-compress anyhow
and does it on the fly anyhow, so there is no extra time needed and in
general it seems to be benefitial to invest the time in update to save
time later on file access.
tests: try to pick up compressors from config automatically2016-01-08T14:40:01ZDavid Kalnischkiesdavid@kalnischkies.de2016-01-03T21:39:46Zurn:sha1:912a61312a0463b46d6560756c89146f59daaab6
Less hardcoding should help while introducing new compressors.
Git-Dch: Ignore
allow pdiff bootstrap from all supported compressors2016-01-08T14:40:01ZDavid Kalnischkiesdavid@kalnischkies.de2016-01-05T23:05:24Zurn:sha1:4e3c5633b1e74b4f58b95f339cfbbf4cbf21ab3e
There is no reason to enforce that the file we start the bootstrap with
is compressed with a compressor which is available online. This allows
us to change the on-disk format as well as deals with repositories
adding/removing support for a specific compressor.
use one 'store' method to rule all (de)compressors2016-01-08T14:40:01ZDavid Kalnischkiesdavid@kalnischkies.de2016-01-03T18:23:30Zurn:sha1:9bd2313a5c7523501bcec398877489c5a1fc1415
Adding a new compressor method meant adding a new method as well – even
if that boilt down to just linking to our generalized decompressor with
a new name. That is unneeded busywork if we can instead just call the
generalized decompressor and let it figure out which compressor to use
based on the filenames rather than by program name.
For compatibility we ship still 'gzip', 'bzip2' and co, but they are
just links to our "new" 'store' method.
test-apt-cache: Adjust for hashtable size change2016-01-03T19:07:19ZJulian Andres Klodejak@debian.org2016-01-03T19:07:19Zurn:sha1:550d53ec86bf8692d9eab9fde49f4ebbf26cb511
Gbp-Dch: ignore
Add new APT::Keep-Downloaded-Packages option2016-01-02T21:18:13ZMichael Vogtmvo@ubuntu.com2016-01-02T21:08:30Zurn:sha1:ee02b5b3949372a178d37cadaa08db0bfd5b991f
This option controls if downloaded packages should be kept after
a successful install or if they should be deleted. The default
for "apt-get" is that they are kept (just like before).
However the default for "apt" is that they get deleted.
Closes: #160743