apt/apt-pkg/acquire.cc, branch 1.9.2

Distribute host-less work based on backlog of the queues

2019-07-08T11:18:31Z

Work like applying patches via rred can be performed by many concurrent rred processes, but we can't just spawn new ones forever: We limit us to the number of CPUs which can drive them and reuse existing ones if they have nothing to do at the moment. The problem arises if we have reached the limit of queues and all of them are busy which is more likely to happen on "slow" machines with few CPUs. In this case we opted for random distribution, but that can result in many big files (e.g. Contents) being added to one queue while the others get none or only small files. Ideally we would ask the methods how much they still have to do, but they only know that for the current item, not for all items in the queue, so we use the filesize of the expected result.

apt-pkg: URI: Add 'explicit' to single argument constructor

2019-04-30T15:43:56Z

This needs a fair amount of changes elsewhere in the code, hence this is separate from the previous commits.

acq: worker: Move CurrentSize, TotalSize, ResumePoint to CurrentItem

2019-04-30T15:40:38Z

These status fields belong to the current item, move them there. This prepares us for eventually having multiple current items.

Don't limit cpu-limited queues to at most 10

2019-04-16T10:59:54Z

Queues for processes like rred are not created by hostname but we spawn at most CPU*2 queues to place items in. The problem is that we then proceeded to limit it to at most 10 queues (via QueueHost::Limit) again at the end of the method so that all items (after the first 10 queues are busy) are forcibly placed into a generic catch-all instance which is bad because we don't keep all CPUs we have available busy and worse we end up sheduling the most work to a single one while random distribution was intended.

acquire: Remove deprecated pkgAcquire::Setup() function

2019-02-26T15:31:20Z

acquire: Fold pkgAcquireStatus2 into pkgAcquireStatus

2019-02-26T15:31:20Z

Clean up the code, make it neat, lalala

Fix calculation of elapsed usec in downloads

2018-09-24T07:27:01Z

A recent change to use chronos inadvertently replaced the difference of new usec - old usec with new sec - old usec, which is obviously wrong.

Use a steady clock source for progress reporting

2018-05-28T15:59:35Z

Clock changes while apt is running can result in strange reports confusing (and amusing) users. Sadly, to keep the ABI for now the code is a bit more ugly than it would need to be.

Remove obsolete RCS keywords

2018-05-07T11:41:31Z

Prompted-by: Jakub Wilk

ensure correct file permissions for auxfiles

2018-02-19T14:56:09Z

The interesting takeaway here is perhaps that 'chmod +w' is effected by the umask – obvious in hindsight of course. The usual setup helps with hiding that applying that recursively on all directories (and files) isn't correct. Ensuring files will not be stored with the wrong permissions even if in strange umask contexts is trivial in comparison. Fixing the test also highlighted that it wasn't bulletproof as apt will automatically fix the permissions of the directories it works with, so for this test we actually need to introduce a shortcut in the code. Reported-By: Ubuntu autopkgtest CI