CloudNebulaProject/solstice-ci
SHA256
1
0
Fork 0
mirror of https://codeberg.org/Toasterson/solstice-ci.git synced 2026-04-10 13:20:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
solstice-ci/crates/orchestrator/Cargo.toml

57 lines
2.2 KiB
TOML
Raw Normal View History

Initial Commit Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-10-25 20:00:32 +02:00
[package]
name = "orchestrator"
Update default SSH user to 'sol' and enhance cloud-init config; bump version to 0.1.15 - Change the default SSH username from 'ubuntu' to 'sol' for consistency with Solstice CI environment. - Modify cloud-init user configuration to align with the new default, adding enhanced permissions and settings for 'sol' user. - Increment orchestrator version to 0.1.15. Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-11-18 14:48:20 +01:00
version = "0.1.15"
Initial Commit Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-10-25 20:00:32 +02:00
edition = "2024"
Add libvirt/KVM integration and Forgejo webhook support to Podman stack - Extend `.env.sample` with libvirt configuration, Forgejo secrets, and image mapping defaults. - Update `compose.yml` to enable libvirt integration, including required mounts, devices, and environment variables. - Add Forgejo webhook configuration and commit status reporting with optional HMAC validation. - Enhance the orchestrator container with libvirt dependencies and optional features for VM management. - Document host preparation for libvirt/KVM and image directories in the README. - Set default fallback values for Traefik ACME CA server. Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-11-09 17:58:36 +01:00
build = "build.rs"
Initial Commit Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-10-25 20:00:32 +02:00
[features]
[dependencies]
common = { path = "../common" }
Enable pure-iso feature for vm-manager (no genisoimage needed)
2026-04-07 21:01:12 +02:00
vm-manager = { git = "https://github.com/CloudNebulaProject/vm-manager.git", branch = "main", features = ["pure-iso"] }
Initial Commit Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-10-25 20:00:32 +02:00
clap = { version = "4", features = ["derive", "env"] }
miette = { version = "7", features = ["fancy"] }
Enhance SSH handling with retries and robust error management, refactor guest IP discovery - Implement SSH execution retries with exponential backoff and timeout handling. - Replace `virsh domifaddr` with a multi-strategy IP discovery approach. - Introduce `OrchestratorError` for consistent, structured error reporting. - Improve runner deployment and SSH session utilities for readability and reliability. - Add dependencies: `thiserror`, `anyhow` for streamlined error handling. Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-11-15 21:46:54 +01:00
thiserror = "1"
anyhow = "1"
Initial Commit Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-10-25 20:00:32 +02:00
tracing = "0.1"
Add per-job SSH key support, refactor scheduler for SSH-based job execution, and remove unused runner endpoint - Introduce fields in `JobContext` for per-job SSH configuration, including user, key paths, and PEM contents. - Update the scheduler to support SSH-based execution of jobs, including VM lifecycle management and SSH session handling. - Add utility functions for SSH execution, guest IP discovery, and runner deployment. - Remove the unused `/runners/{name}` HTTP endpoint and its associated logic. - Simplify router creation by refactoring out disabled runner directory handling. Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-11-15 18:37:30 +01:00
tokio = { version = "1", features = ["rt-multi-thread", "macros", "signal", "fs", "io-util", "process", "net"] }
Initial Commit Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-10-25 20:00:32 +02:00
serde = { version = "1", features = ["derive"] }
Enhance hypervisor image handling with dynamic format detection and raw conversion This commit improves the hypervisor by: - Adding support for detecting base image formats using `qemu-img info`. - Dynamically setting the base image format for overlay creation. - Automatically converting non-raw images to raw format for bhyve compatibility. - Updating `Cargo.toml` to include `serde_json` for JSON parsing. - Modifying default working directory logic for `ZonesHypervisor`.
2025-10-26 18:17:02 +01:00
serde_json = "1"
Initial Commit Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-10-25 20:00:32 +02:00
serde_yaml = "0.9"
Update parsing logic and upgrade dependencies across crates This commit updates parsing logic by simplifying `.and_then(|e| e.value().as_string())` calls to `.and_then(|v| v.as_string())`. Additionally, it upgrades several crate dependencies, including `thiserror`, `sea-orm`, `lapin`, `virt`, and `kdl`, to their latest compatible versions for improved functionality and stability.
2025-11-01 14:44:16 +01:00
config = { version = "0.15", default-features = false, features = ["yaml"] }
Initial Commit Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-10-25 20:00:32 +02:00
reqwest = { version = "0.12", default-features = false, features = ["rustls-tls-native-roots", "http2", "gzip", "brotli", "zstd"] }
Add per-job SSH key support, refactor scheduler for SSH-based job execution, and remove unused runner endpoint - Introduce fields in `JobContext` for per-job SSH configuration, including user, key paths, and PEM contents. - Update the scheduler to support SSH-based execution of jobs, including VM lifecycle management and SSH session handling. - Add utility functions for SSH execution, guest IP discovery, and runner deployment. - Remove the unused `/runners/{name}` HTTP endpoint and its associated logic. - Simplify router creation by refactoring out disabled runner directory handling. Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-11-15 18:37:30 +01:00
# HTTP server for logs (runner serving removed)
Enable job log persistence, HTTP server, and extend CI/packaging support This commit introduces: - Log persistence feature with a new `job_logs` table and related APIs for recording and retrieving job logs. - An HTTP server for serving log endpoints and job results. - Updates to the CI pipeline to enable persistence by default and ensure PostgreSQL readiness. - Docker Compose updates with a Postgres service and MinIO integration for object storage. - Packaging scripts for Arch Linux, including systemd service units for deployment.
2025-11-02 23:37:11 +01:00
axum = { version = "0.8", features = ["macros"] }
Remove libvirt dependencies and clean up orchestrator - Remove `virt` crate dependency and libvirt feature flag - Remove `ssh2` crate dependency (vm-manager handles SSH) - Remove `zstd` crate dependency (vm-manager handles decompression) - Remove LibvirtHypervisor, ZonesHypervisor, RouterHypervisor from hypervisor.rs - Remove libvirt error types from error.rs - Remove libvirt_uri/libvirt_network CLI options, add network_bridge - Replace RouterHypervisor::build() with VmManagerAdapter::build() - Update deb package depends: libvirt → qemu-system-x86 - Keep Noop backend for development/testing - Dead old SSH/console functions left for future cleanup
2026-04-07 15:56:10 +02:00
# SSH key generation (vm-manager handles SSH connections)
Add per-job SSH key support, refactor scheduler for SSH-based job execution, and remove unused runner endpoint - Introduce fields in `JobContext` for per-job SSH configuration, including user, key paths, and PEM contents. - Update the scheduler to support SSH-based execution of jobs, including VM lifecycle management and SSH session handling. - Add utility functions for SSH execution, guest IP discovery, and runner deployment. - Remove the unused `/runners/{name}` HTTP endpoint and its associated logic. - Simplify router creation by refactoring out disabled runner directory handling. Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-11-15 18:37:30 +01:00
ssh-key = { version = "0.6", features = ["ed25519"] }
rand_core = "0.6"
Initial Commit Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-10-25 20:00:32 +02:00
# DB (optional basic persistence)
Update parsing logic and upgrade dependencies across crates This commit updates parsing logic by simplifying `.and_then(|e| e.value().as_string())` calls to `.and_then(|v| v.as_string())`. Additionally, it upgrades several crate dependencies, including `thiserror`, `sea-orm`, `lapin`, `virt`, and `kdl`, to their latest compatible versions for improved functionality and stability.
2025-11-01 14:44:16 +01:00
sea-orm = { version = "1.1.17", default-features = false, features = ["sqlx-postgres", "sqlx-sqlite", "runtime-tokio-rustls", "macros", "with-uuid", "with-chrono" ] }
Add orchestrator persistence using SeaORM for initial database support This commit introduces a persistence layer to the Orchestrator, enabling it to optionally connect to a Postgres database for recording job and VM states. It includes: - SeaORM integration with support for migrations from the migration crate. - `Persist` module with methods for job and VM state upserts. - No-op fallback when persistence is disabled or unavailable. - Documentation updates and test coverage for persistence functionality.
2025-10-26 15:38:54 +01:00
migration = { path = "../migration" }
Update parsing logic and upgrade dependencies across crates This commit updates parsing logic by simplifying `.and_then(|e| e.value().as_string())` calls to `.and_then(|v| v.as_string())`. Additionally, it upgrades several crate dependencies, including `thiserror`, `sea-orm`, `lapin`, `virt`, and `kdl`, to their latest compatible versions for improved functionality and stability.
2025-11-01 14:44:16 +01:00
sea-orm-migration = { version = "1.1.17" }
Add orchestrator persistence using SeaORM for initial database support This commit introduces a persistence layer to the Orchestrator, enabling it to optionally connect to a Postgres database for recording job and VM states. It includes: - SeaORM integration with support for migrations from the migration crate. - `Persist` module with methods for job and VM state upserts. - No-op fallback when persistence is disabled or unavailable. - Documentation updates and test coverage for persistence functionality.
2025-10-26 15:38:54 +01:00
chrono = { version = "0.4", default-features = false, features = ["clock", "std", "serde"] }
Initial Commit Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-10-25 20:00:32 +02:00
# Utilities
dashmap = "6"
async-trait = "0.1"
Add orchestrator persistence using SeaORM for initial database support This commit introduces a persistence layer to the Orchestrator, enabling it to optionally connect to a Postgres database for recording job and VM states. It includes: - SeaORM integration with support for migrations from the migration crate. - `Persist` module with methods for job and VM state upserts. - No-op fallback when persistence is disabled or unavailable. - Documentation updates and test coverage for persistence functionality.
2025-10-26 15:38:54 +01:00
uuid = { version = "1", features = ["v4", "serde"] }
Switch orchestrator from `libvirt` crate to `virt` crate for Linux hypervisor backend This commit replaces the `libvirt` crate with the `virt` crate for managing the libvirt backend on Linux. Key changes include: - Updated `Cargo.toml` dependencies and feature configuration. - Refactored hypervisor implementation to align with `virt` crate API. - Improved error handling and lifecycle management for VMs and networks.
2025-10-26 16:08:36 +01:00
Add Debian packaging support and network configuration enhancements - Introduce Debian package build script using `cargo-deb` for orchestrator releases. - Add systemd unit file and post-installation script for automatic service setup. - Update `compose.yml` with host-only port bindings for Postgres and RabbitMQ. - Introduce NGINX-based log proxy for orchestrator logs with Traefik support. - Bump orchestrator version to 0.1.1 and update related Cargo metadata for packaging. - Add example environment file for orchestrator configuration. Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-11-17 19:57:19 +01:00
[package.metadata.deb]
name = "solstice-orchestrator"
maintainer = "Solstice CI <ops@solstice-ci.org>"
section = "utils"
priority = "optional"
assets = [
["target/release/orchestrator", "/usr/bin/solstice-orchestrator", "755"],
["packaging/solstice-orchestrator.service", "/lib/systemd/system/solstice-orchestrator.service", "644"],
["../../examples/orchestrator-image-map.yaml", "/etc/solstice/orchestrator.yaml", "644"],
["../../examples/etc/solstice/orchestrator.env.sample", "/etc/solstice/orchestrator.env", "640"],
]
depends = [
Remove libvirt dependencies and clean up orchestrator - Remove `virt` crate dependency and libvirt feature flag - Remove `ssh2` crate dependency (vm-manager handles SSH) - Remove `zstd` crate dependency (vm-manager handles decompression) - Remove LibvirtHypervisor, ZonesHypervisor, RouterHypervisor from hypervisor.rs - Remove libvirt error types from error.rs - Remove libvirt_uri/libvirt_network CLI options, add network_bridge - Replace RouterHypervisor::build() with VmManagerAdapter::build() - Update deb package depends: libvirt → qemu-system-x86 - Keep Noop backend for development/testing - Dead old SSH/console functions left for future cleanup
2026-04-07 15:56:10 +02:00
"qemu-system-x86",
"qemu-utils",
Add Debian packaging support and network configuration enhancements - Introduce Debian package build script using `cargo-deb` for orchestrator releases. - Add systemd unit file and post-installation script for automatic service setup. - Update `compose.yml` with host-only port bindings for Postgres and RabbitMQ. - Introduce NGINX-based log proxy for orchestrator logs with Traefik support. - Bump orchestrator version to 0.1.1 and update related Cargo metadata for packaging. - Add example environment file for orchestrator configuration. Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-11-17 19:57:19 +01:00
"ca-certificates",
]
Remove libvirt dependencies and clean up orchestrator - Remove `virt` crate dependency and libvirt feature flag - Remove `ssh2` crate dependency (vm-manager handles SSH) - Remove `zstd` crate dependency (vm-manager handles decompression) - Remove LibvirtHypervisor, ZonesHypervisor, RouterHypervisor from hypervisor.rs - Remove libvirt error types from error.rs - Remove libvirt_uri/libvirt_network CLI options, add network_bridge - Replace RouterHypervisor::build() with VmManagerAdapter::build() - Update deb package depends: libvirt → qemu-system-x86 - Keep Noop backend for development/testing - Dead old SSH/console functions left for future cleanup
2026-04-07 15:56:10 +02:00
recommends = ["qemu-kvm"]
Add Debian packaging support and network configuration enhancements - Introduce Debian package build script using `cargo-deb` for orchestrator releases. - Add systemd unit file and post-installation script for automatic service setup. - Update `compose.yml` with host-only port bindings for Postgres and RabbitMQ. - Introduce NGINX-based log proxy for orchestrator logs with Traefik support. - Bump orchestrator version to 0.1.1 and update related Cargo metadata for packaging. - Add example environment file for orchestrator configuration. Signed-off-by: Till Wegmueller <toasterson@gmail.com>
2025-11-17 19:57:19 +01:00
conf-files = ["/etc/solstice/orchestrator.yaml", "/etc/solstice/orchestrator.env"]
maintainer-scripts = "packaging/debian/"
Reference in a new issue Copy permalink