Debians commandline package manager https://git.kalnischkies.de/apt/atom?h=1.3_pre2 2016-05-27T17:14:38Z 2016-05-27T17:14:38Z David Kalnischkies david@kalnischkies.de 2016-05-27T16:10:39Z urn:sha1:b58e2c7c56b1416a343e81f9f80cb1f02c128e25 Setting the C++ locale via std::locale::global(std::locale("")); which would otherwise default to the default C locale (aka: unaffected by setlocale) effects the formatting of numeric types in IO streams, which for output for humans is perfectly sensible, but breaks our many text interfaces used and parsed by us and others without expecting the numbers to be formatted. Closes: #825396 2016-05-27T12:08:44Z David Kalnischkies david@kalnischkies.de 2016-05-27T10:08:32Z urn:sha1:124e6916b7b02984803ff8217e8163947aae2882 libapt allows to configure compressors to be used by its system via configuration implemented in 03bef78461c6f443187b60799402624326843396, but that was never really documented and also only partly working, which also explains why the tests weren't using it… 2016-05-07T12:44:53Z David Kalnischkies david@kalnischkies.de 2016-05-07T12:44:53Z urn:sha1:1eba782fc3c55528a4da14d79e114874b9299453 Progress reporting used an "upper bound" on files we might get, expect that this wasn't correct in case pdiff entered the picture. So instead of calculating a value which is perhaps incorrect, we just accept that we can't tell how many files we are going to download and just keep at 0% until we know. Additionally, if we have pdiffs we wait until we got these (sub)index files, too. That could all be done better by downloading all Release files first and planing with them in hand accordingly, but one step at a time. 2016-04-25T13:35:52Z David Kalnischkies david@kalnischkies.de 2016-04-06T10:50:26Z urn:sha1:4aa6ebf6d78131416ef173b1ce472f014da25136 Queues feeding workers like rred are created in a random pattern to get a few of them to run in parallel – but if we already have an idling queue we don't need to assign it to a (potentially new) random queue as that saves us the (agruably small) overhead of starting up a new queue, avoids adding jobs to an already busy queue while others idle and as a bonus reduces the size of debug logs a bit. We also keep starting new queues now until we reach our limit before we assign work at random to them, which should give us a more effective utilisation overall compared to potentially adding work to busy queues while we haven't reached our queue limit yet. 2016-03-16T16:52:40Z Michael Vogt mvo@ubuntu.com 2016-03-15T13:50:37Z urn:sha1:fb193b1cd43f0e8c3b7e5f69f183b9abe7e83761 For the non-pdiff case, we have can have accurate progress reporting because after fetching the {,In}Release files we know how many IndexFiles will be fetched and what size they have. Therefore init the filesize early (in pkgAcqIndex::Init) and ensure that in Acquire::Pulse() looks at already downloaded bits when calculating the progress in Acquire::Pulse. Also improve debug output of Debug::acquire::progress 2016-02-11T22:13:47Z David Kalnischkies david@kalnischkies.de 2016-02-11T21:54:49Z urn:sha1:6fd4b4c0b693b52cb8b593b76e5b60f77e500454 pkgAcqChangelog has the default behaviour of downloading a changelog to a temporary directory (inside /tmp, not /tmp directly), which is cleaned up on shutdown, but this can be overridden to store the changelog more permanently – but that caries a permission problem. For changelog we can 'easily' solve this by always downloading to a temporary directory and only move it out of there on done. 2016-01-15T01:45:35Z David Kalnischkies david@kalnischkies.de 2016-01-15T01:45:35Z urn:sha1:feb674aba51dcb26f5281b5b38fbc5893f757170 Introduced in 9d2a8a7388cf3b0bbbe92f6b0b30a533e1167f40 apt tries to merge actions like downloading the same (as judged by hashes) file into doing it once. The implementation was very simple in that it isn't planing at all. Turns out that it works 90% of the time just fine, but has issues in more complicated situations in which items can be in different stages downloading different files emitting potentially the "wrong" hash – like while pdiffs are worked on we might end up copying the patch instead of the result file giving us very strange errors in return. Reverting the change until we can implement a better planing solution seems to be the best course of action even if its sad. Closes: 810046 2016-01-07T16:31:24Z Julian Andres Klode jak@debian.org 2016-01-07T16:06:55Z urn:sha1:b89cd2e36f9696ccd56167593c792116ae4fc97f The maximum parallelization soft limit is the number of CPU cores * 2 on systems defining _SC_NPROCESSORS_ONLN. The hard limit in all cases is Acquire::QueueHost::Limit. 2015-12-07T13:45:52Z Julian Andres Klode jak@debian.org 2015-12-07T13:45:52Z urn:sha1:e551e1237da3cbba71f08f17dc57b07832b8d9ac Gbp-Dch: ignore 2015-12-07T13:44:15Z Julian Andres Klode jak@debian.org 2015-12-07T13:42:25Z urn:sha1:5a97834817dd43b7833881f38f512a9f2fdac8a9 We need to pass 0llu instead of 0 as the init value, otherwise std::accumulate will calculate with ints. Reported-by: Raphaël Hertzog