Debians commandline package manager https://git.kalnischkies.de/apt/atom?h=1.4_beta4 2016-11-24T23:15:13Z 2016-11-24T23:15:13Z David Kalnischkies david@kalnischkies.de 2016-11-13T01:29:46Z urn:sha1:5832913a49d4f7c75527264a935cc0ce00627f1d In ad9416611ab83f7799f2dcb4bf7f3ef30e9fe6f8 we fall back to asking the original mirror (e.g. a redirector) if we do not get the expected result. This works for the indexes, but patches are a different beast and much simpler. Adding this fallback code here seems like overkill as they are usually right along their Index file, so actually forward the relevant settings to the patch items which fixes pdiff support combined with a redirector and partial mirrors as in such a situation the pdiff patches would be 404 and the complete index would be downloaded. 2016-11-11T22:40:39Z David Kalnischkies david@kalnischkies.de 2016-11-11T12:15:27Z urn:sha1:7434f15cb688f3a394accba2ce10615adcb9c48a We have the last Release file around for other checks, so its trivial to look if the new Release file contains a new codename (e.g. the user has "testing" in the sources and it flipped from stretch to buster). Such a change can be okay and expected, but also be a hint of problems, so a warning if we see it happen seems okay. We can only print it once anyhow and frontends and co are likely to ignore/hide it. 2016-11-11T22:40:39Z David Kalnischkies david@kalnischkies.de 2016-11-11T12:05:38Z urn:sha1:d0c7d4d6328418b7c9f434a3398e5f7e08b7359c A suite or codename entry in the Release file is checked against the distribution field in the sources.list entry that lead to the download of that Release file. This distribution entry can contain slashes in the distribution field: deb http://security.debian.org/debian wheezy/updates main However, the Release file may only contain "wheezy" in the Codename field and not "wheezy/updates". So a transformation needs to take place that removes the last / and everything that comes after (e.g. "/updates"). This fails, however, for valid cases like a reprepro snapshot where the given Codename contains slashes but is perfectly fine and doesn't need to be transformed. Since that transformation is essentially just a workaround for special cases like the security repository, it should be checked if the literal Codename without any transformations happened is valid and only if isn't the dist should be checked against the transformated one. This way special cases like security.debian.org are handled and reprepro snapshots work too. The initial patch was taken as insperationto move whole transformation to CheckDist() which makes this method more accepting & easier to use (but according to codesearch.d.n we are the only users anyhow). Thanks: Lukas Anzinger for initial patch Closes: 644610 2016-11-09T22:32:02Z David Kalnischkies david@kalnischkies.de 2016-11-09T22:32:02Z urn:sha1:28ee7f19b865c32ce1b03cc0afa26983a0208693 Some people do not recognize the field value with such an arcane name and/or expect it to refer to something different (e.g. #839257). We can't just rename it internally as its an avoidance strategy as such fieldname existed previously with less clear semantics, but we can spare the general public from this implementation detail. 2016-11-02T08:36:49Z David Kalnischkies david@kalnischkies.de 2016-10-06T16:30:51Z urn:sha1:84eec207be35b8c117c430296d4c212b079c00c1 A user relying on the deprecated behaviour of apt-get to accept a source with an unknown pubkey to install a package containing the key expects that the following 'apt-get update' causes the source to be considered as trusted, but in case the source hadn't changed in the meantime this wasn't happening: The source kept being untrusted until the Release file was changed. This only effects sources not using InRelease and only apt-get, the apt binary downright refuses this course of actions, but it is a common way of adding external sources. Closes: 838779 2016-09-02T15:16:36Z Julian Andres Klode jak@debian.org 2016-06-15T21:13:43Z urn:sha1:2a440328ea19e9646a93f847dd9eff21e03ad16d Employ a priority queue instead of a normal queue to hold the items; and only add items to the running pipeline if their priority is the same or higher than the priority of items in the queue. The priorities are designed for a 3 stage pipeline system: In stage 1, all Release files and .diff/Index files are fetched. This allows us to determine what files remain to be fetched, and thus ensures a usable progress reporting. In stage 2, all Pdiff patches are fetched, so we can apply them in parallel with fetching other files in stage 3. In stage 3, all other files are fetched (complete index files such as Contents, Packages). Performance improvements, mainly from fetching the pdiff patches before complete files, so they can be applied in parallel: For the 01 Sep 2016 03:35:23 UTC -> 02 Sep 2016 09:25:37 update of Debian unstable and testing with Contents and appstream for amd64 and i386, update time reduced from 37 seconds to 24-28 seconds. Previously, apt would first download new DEP11 icon tarballs and metadata files, causing the CPU to be idle. By fetching the diffs in stage 2, we can now patch our contents and Packages files while we are downloading the DEP11 stuff. 2016-08-29T07:22:25Z David Kalnischkies david@kalnischkies.de 2016-08-28T10:58:20Z urn:sha1:4ff5e237d5685be187a75c563b86e80ea3e7cc01 Without randomizing the order in which we download the index files we leak needlessly information to the mirrors of which architecture is native or foreign on this system. More importantly, we leak the order in which description translations will be used which in most cases will e.g. have the native tongue first. Note that the leak effect in practice is limited as apt detects if a file it wants to download is already available in the latest version from a previous download and does not query the server in such cases. Combined with the fact that Translation files are usually updated infrequently and not all at the same time, so a mirror can never be sure if it got asked about all files the user wants. 2016-08-26T22:31:03Z Julian Andres Klode jak@debian.org 2016-08-26T22:31:03Z urn:sha1:6a68315e938eb2611806658828ecea86805822e7 2016-08-26T20:24:25Z Julian Andres Klode jak@debian.org 2016-08-25T14:25:00Z urn:sha1:6f1f3c9afdb6ade6a7be110b90c8fc9e603254cf This is needed on BSD where root's default group is wheel, not root. 2016-08-26T20:24:24Z Julian Andres Klode jak@debian.org 2016-08-25T12:24:49Z urn:sha1:2ed62ba6abcad809d1898a40950f86217af73812 This fixes issues with chroots, but the goal here was to get the test suite working on systems without dpkg.