apt/test/integration/test-partial-file-support, branch 1.4.5Debians commandline package managerhttps://git.kalnischkies.de/apt/atom?h=1.4.52016-08-16T16:49:37Zdon't sent Range requests if we know its not accepted2016-08-16T16:49:37ZDavid Kalnischkiesdavid@kalnischkies.de2016-08-11T16:24:35Zurn:sha1:d94b1d80d8326334d17f6a43061368e783b8e0aa
If the server told us in a previous request that it isn't supporting
Ranges with bytes via an Accept-Ranges header missing bytes, we don't
try to formulate requests using Ranges.
use the same redirection handling for http and https2016-08-10T21:19:44ZDavid Kalnischkiesdavid@kalnischkies.de2016-08-02T12:49:58Zurn:sha1:4bba5a88d0f6afde4414b586b64c48a4851d5324
cURL which backs our https implementation can handle redirects on its
own, but by dealing with them on our own we gain finer control over which
redirections will be performed (we don't like https → http) and by whom
so that redirections to other hosts correctly spawn a new https method
dealing with these instead of letting the current one deal with it.
Do not consider SHA1 usable2016-03-13T12:01:14ZJulian Andres Klodejak@debian.org2016-03-13T11:21:09Zurn:sha1:51c04562559d0924aa52cc8c9b69901bc8a5c945
SHA1 is not reasonably secure anymore, so we should not consider it
usable anymore. The test suite is adjusted to account for this.
tests: support spaces in path and TMPDIR2015-12-19T22:04:34ZDavid Kalnischkiesdavid@kalnischkies.de2015-12-15T16:20:26Zurn:sha1:3abb6a6a1e485b3bc899b64b0a1b7dc2db25a9c2
This doesn't allow all tests to run cleanly, but it at least allows to
write tests which could run successfully in such environments.
Git-Dch: Ignore
tests: don't use hardcoded port for http and https2015-09-15T08:16:09ZDavid Kalnischkiesdavid@kalnischkies.de2015-09-14T22:33:12Zurn:sha1:6c0765c096ffb4df14169236c865bbb2b10974ae
This allows running tests in parallel.
Git-Dch: Ignore
detect 416 complete file in partial by expected hash2015-05-11T22:30:16ZDavid Kalnischkiesdavid@kalnischkies.de2015-05-11T22:30:16Zurn:sha1:dcbb364fc69e1108b3fea3adb12a7ba83d9af467
If we have the expected hashes we can check with them if the file we
have in partial we got a 416 for is the expected file. We detected this
with same-size before, but not every server sends a good Content-Range
header with a 416 response.
improve partial/ cleanup in abort and failure cases2015-05-11T15:22:32ZDavid Kalnischkiesdavid@kalnischkies.de2015-04-27T08:59:27Zurn:sha1:146f7715a9f36d246b461255b3c683b479296915
Especially pdiff-enhanced downloads have the tendency to fail for
various reasons from which we can recover and even a successful download
used to leave the old unpatched index in partial/.
By adding a new method responsible for making the transaction of an
individual file happen we can at specialisations especially for abort
cases to deal with the cleanup.
This also helps in keeping the compressed indexes around if another
index failed instead of keeping the decompressed files, which we
wouldn't pick up in the next call.
dispose http(s) 416 error page as non-content2014-12-09T00:13:48ZDavid Kalnischkiesdavid@kalnischkies.de2014-11-29T16:59:52Zurn:sha1:ed793a19ec00b83254029509bc516e3ba911c75a
Real webservers (like apache) actually send an error page with a 416
response, but our client didn't expect it leaving the page on the socket
to be parsed as response for the next request (http) or as file content
(https), which isn't what we want at all… Symptom is a "Bad header line"
as html usually doesn't parse that well to an http-header.
This manifests itself e.g. if we have a complete file (or larger) in
partial/ which isn't discarded by If-Range as the server doesn't support
it (or it is just newer, think: mirror rotation).
It is a sort-of regression of 78c72d0ce22e00b194251445aae306df357d5c1a,
which removed the filesize - 1 trick, but this had its own problems…
To properly test this our webserver gains the ability to reply with
transfer-encoding: chunked as most real webservers will use it to send
the dynamically generated error pages.
Closes: 768797
chown finished partial files earlier2014-10-22T23:28:05ZDavid Kalnischkiesdavid@kalnischkies.de2014-10-22T23:28:05Zurn:sha1:03aa08472dcd689572a46ce6efdb1dccf6136334
partial files are chowned by the Item baseclass to let the methods work
with them. Now, this baseclass is also responsible for chowning the
files back to root instead of having various deeper levels do this.
The consequence is that all overloaded Failed() methods now call the
Item::Failed base as their first step. The same is done for Done().
The effect is that even in partial files usually don't belong to
_apt anymore, helping sneakernets and reducing possibilities of a bad
method modifying files not belonging to them.
The change is supported by the framework not only supporting being run
as root, but with proper permission management, too, so that privilege
dropping can be tested with them.
improve debug output in case downloadfile fails2014-03-13T12:58:46ZDavid Kalnischkiesdavid@kalnischkies.de2014-03-10T13:15:45Zurn:sha1:0d58c26ad7b2308f08f4e6002cbf218605c1c7cf
Git-Dch: Ignore