summaryrefslogtreecommitdiffstats
path: root/crates
AgeCommit message (Collapse)Author
2021-11-01runner: detect file conflicts in dependencies againMatthias Schiffer
The new code will also detect conflicts between the rootfs and individual dependencies.
2021-10-31driver: add to e2fsprogs to rootfs tasksMatthias Schiffer
e2fsprogs is provided by our Debian-based rootfs image. Signed-off-by: Matthias Schiffer <mschiffer@universe-factory.net>
2021-10-31driver: add toolchain prefix to PATHMatthias Schiffer
Signed-off-by: Matthias Schiffer <mschiffer@universe-factory.net>
2021-10-31runner: unpack dependencies only onceMatthias Schiffer
Reuse unpacked dependencies across multiple tasks by mounting them into a single task's build directory. We lose support for file conflict detection for now.
2021-10-31runner: add Stack typeMatthias Schiffer
A Stack guarantees that elements are dropped in reverse push order.
2021-10-30runner: set up /dev in separate directoryMatthias Schiffer
Preparation for removal of a single rootfs.
2021-10-30runner: do not use tmpfs for temporary build directoriesMatthias Schiffer
2021-10-30runner: move lockfile out of state directoryMatthias Schiffer
2021-10-30runner: remove unneeded reference reported by clippyMatthias Schiffer
2021-10-30runner: verify hash when unpacking dependenciesMatthias Schiffer
2021-10-30examples: move recipes to subdirectoryMatthias Schiffer
2021-10-30driver: replace dependency cutoff with stub tasksMatthias Schiffer
Instead of having the resolver decide whether a dependency is included in the rootfs, let the context replace the task definition with an empty stub.
2021-10-30driver: context: change get()/index() argument to TaskRefMatthias Schiffer
With the upcoming changes, we may need to return different TaskDefs depending on the passed arguments.
2021-10-30driver: skip submission of empty tasksMatthias Schiffer
2021-10-30Make TaskOutput input hash optionalMatthias Schiffer
The input hash is used for the summary output only. For empty tasks, we want to skip submitting the task to the runner at all, so there is no input hash.
2021-10-30driver: context: more consistent use specificationMatthias Schiffer
2021-10-29driver: recipe: use common error typesMatthias Schiffer
2021-10-28Pass workdir from driver to runnerMatthias Schiffer
The paths modules of driver and runner do not contain any duplicates anymore. One remaining path that still appears in more places than it should is /build.
2021-10-28runner: drop paths::abs() functionMatthias Schiffer
2021-10-28Move handling of current directory of task to driverMatthias Schiffer
2021-10-28Pass target directory for download archives from driver to runnerMatthias Schiffer
2021-10-28Split paths module into driver and runner partsMatthias Schiffer
There are still a few remaining paths that are defined in both driver and runner.
2021-10-28Pass full Output path to runnerMatthias Schiffer
Concatenate TASK_DESTDIR with output path in driver instead of runner to reduce amount of shared logic between driver and runner.
2021-10-28Rename executor to driverMatthias Schiffer
2021-10-28executor: move some state into separate structMatthias Schiffer
2021-10-28executor: use lazy_static for template engineMatthias Schiffer
2021-10-27runner: get rid of spawn argument funnellingMatthias Schiffer
2021-10-27runner: tar: simplify spawn callMatthias Schiffer
The writing end of the pipe is moved to the child process, there is no need to funnel it back to the parent process just to drop it.
2021-10-27runner: add Steal wrapper, use for socketMatthias Schiffer
A deref wrapper that allows taking out its contents, which is convenient after a fork.
2021-10-26runner: move Checkable trait into separabe moduleMatthias Schiffer
2021-10-26runner: remove another layer of child processesMatthias Schiffer
With the restructuring around the poll loop and moving the job token handling to the task process, this has become unnecessary as well.
2021-10-26runner: move jobserver token handling into task processMatthias Schiffer
We can avoid holding onto a token while waiting on a lock this way. Abnormal exits that would make us lose tokens should not happen here; if they do, the runner PID1 will stop the whole build, so a lost token does not matter.
2021-10-26runner: maintain list of task PIDs in contextMatthias Schiffer
2021-10-26runner: add RunnerContext structMatthias Schiffer
Bundle common variables passed to different functions.
2021-10-26runner: move more code into the actual task processMatthias Schiffer
Leave only the jobserver token handling in the task spawner process.
2021-10-26runner: pass jobserver to task handler as referenceMatthias Schiffer
Some code simplification.
2021-10-26runner: handle reaping and requests in the poll loopMatthias Schiffer
2021-10-26runner: wait for signals using poll()Matthias Schiffer
2021-10-26runner: use signal fd to wait for exiting child processesMatthias Schiffer
Will be used to poll for new tasks and signals in the same process.
2021-10-26executor: context: remove unneeded Serialize impl on TaskRef/OutputRefMatthias Schiffer
2021-10-26Replace ipc-channel with UNIX sockets and manual FD passingMatthias Schiffer
The new implementation is more flexible, as it allows mixed polling with other FD types, and it saves us a whole zoo of dependencies.
2021-10-26Switch to 2021 editionMatthias Schiffer
2021-10-26runner: hold lock on task state dir while task is runningMatthias Schiffer
Do not allow concurrent runs of the same task.
2021-10-26runner: do not delete whole task dir, only layer and work dirMatthias Schiffer
We will also store a lockfile in the taskdir that must not be deleted.
2021-10-26runner: make lock() function more genericMatthias Schiffer
2021-10-25Allow to set the maximum number of jobs on the command lineMatthias Schiffer
2021-10-25Add lockfile for build state directoryMatthias Schiffer
Use flock() to ensure that there are no concurrent instances using the same build state. More fine-gained locking may be implemented in the future.
2021-10-25Move main crate to subdirectoryMatthias Schiffer
2021-10-25Move runner into separate crateMatthias Schiffer
2021-10-24Split defintions used by both runner and executor into separate crateMatthias Schiffer
Also get rid of the Runner trait - different runner implementations do not make sense with our current design.