feat: import Chinese-localized Buzz source snapshot
Docker image / Build (linux/amd64) (push) Has been cancelled
Docker image / Build (linux/arm64) (push) Has been cancelled
Docker image / Merge release multi-arch manifest (push) Has been cancelled
Docker image / Merge debug multi-arch manifest (push) Has been cancelled
Docker image / Build public push gateway (linux/amd64) (push) Has been cancelled
Docker image / Build public push gateway (linux/arm64) (push) Has been cancelled
Docker image / Publish public push gateway image (push) Has been cancelled
Sprig image / Build (linux/amd64) (push) Has been cancelled
Sprig image / Build (linux/arm64) (push) Has been cancelled
Sprig image / Merge multi-arch manifest (push) Has been cancelled
Harbor Buzz Orchestra / Python tests and lint (push) Has been cancelled
CI / Detect Changed Paths (push) Has been cancelled
CI / Rust Lint (push) Has been cancelled
CI / Unit Tests (push) Has been cancelled
CI / Desktop Core (push) Has been cancelled
CI / Desktop Smoke E2E (1) (push) Has been cancelled
CI / Desktop Smoke E2E (2) (push) Has been cancelled
CI / Desktop Smoke E2E (3) (push) Has been cancelled
CI / Desktop Smoke E2E (4) (push) Has been cancelled
CI / Desktop (push) Has been cancelled
CI / Desktop E2E Relay (push) Has been cancelled
CI / Desktop E2E Integration (1/2) (push) Has been cancelled
CI / Desktop E2E Integration (2/2) (push) Has been cancelled
CI / Desktop E2E Integration (push) Has been cancelled
CI / Backend Integration (relay e2e) (push) Has been cancelled
CI / Relay E2E (push) Has been cancelled
CI / Web (push) Has been cancelled
CI / Mobile (push) Has been cancelled
CI / Security (push) Has been cancelled
CI / Dead Token Reference Guard (push) Has been cancelled
CI / Server Cross-Compile (aarch64-unknown-linux-musl) (push) Has been cancelled
CI / Server Cross-Compile (x86_64-unknown-linux-musl) (push) Has been cancelled
CI / Windows Rust (x86_64-pc-windows-msvc) (push) Has been cancelled
CI / Desktop Build (macOS) (push) Has been cancelled
helm chart / lint + unittest + render matrix (push) Has been cancelled
helm chart / install on kind (gated) (push) Has been cancelled
helm chart / publish chart to GHCR (push) Has been cancelled
Mesh Lifecycle / Relay-Driven Mesh Lifecycle Smoke (push) Has been cancelled
Sprig / Build (aarch64-unknown-linux-musl) (push) Has been cancelled
Sprig / Build (x86_64-unknown-linux-musl) (push) Has been cancelled
Sprig / Publish rolling release (push) Has been cancelled
Sprig / Publish tagged release (push) Has been cancelled

Signed-off-by: cls_宁波本机 <908705107@qq.com>
This commit is contained in:
2026-08-13 18:34:25 +08:00
parent 61c3fa1df9
commit 9dfa06ffee
3785 changed files with 1085458 additions and 2 deletions
@@ -0,0 +1,291 @@
//! End-to-end acceptance tests for Buzz shared compute.
//!
//! These tests require a membership-gated buzz-relay and a mesh-enabled desktop
//! publishing its client-signed discovery note. Live-inference rows additionally
//! require two desktop mesh nodes (serve + client).
//! All tests are `#[ignore]` by default — they need infra CI does not host
//! (native llama, multi-node, model download). The deterministic trust
//! invariants are unit-tested in the desktop mesh module; this file is the
//! opt-in full-stack acceptance layer.
//!
//! # Running (manual / runbook)
//!
//! ```text
//! # 1. prepare the matching native runtime with `scripts/ensure-mesh-native-runtime.sh`
//! # 2. start the normal membership-gated relay and a mesh-enabled desktop
//! # 3. have that desktop publish status, then run the trust assertions:
//! RELAY_URL=ws://localhost:3000 \
//! cargo test --test e2e_mesh_llm trust -- --ignored --nocapture
//! # 4. run the live A->B inference row (needs 2 mesh nodes + a small model):
//! # point at B's local OpenAI endpoint; without it the test SKIPS (no silent pass):
//! MESH_OPENAI_BASE=http://127.0.0.1:9337/v1 \
//! cargo test --test e2e_mesh_llm live_agent_completes -- --ignored --nocapture
//! # MEMBER_NSEC is the publishing desktop identity; STRANGER_NSEC is not a member:
//! MEMBER_NSEC=nsec1... STRANGER_NSEC=nsec1... \
//! cargo test --test e2e_mesh_llm trust -- --ignored --nocapture
//! ```
//!
//! ## Acceptance matrix (= the demo, as a test)
//! | # | Assertion | This file | Also covered by |
//! |---|-----------|-----------|-----------------|
//! | 1 | member reads its kind:30003 owner-bound status, no secrets | `trust_member_reads_mesh_status` | desktop discovery units |
//! | 2 | non-member REQ for kind:30003 returns nothing | `trust_nonmember_read_denied` | relay membership tests |
//! | 3 | untrusted Mesh owner cannot infer with a leaked join token | hardware harness | `mesh_admission_smoke` |
//! | 4 | B's agent completes a chat against A's model over mesh | `live_agent_completes_chat_over_mesh` | runbook |
//! | 5 | dropped member → typed auth failure reaches lastError | runbook (desktop harness) | buzz-agent `-32001` unit |
//! | 6 | split: model too big → 2 serve nodes → chat completes | `live_split_model_completes` | runbook |
use std::time::Duration;
use buzz_test_client::BuzzTestClient;
use nostr::{Alphabet, Filter, Keys, Kind, SingleLetterTag};
/// NIP-51 bookmark set used for client-owned Mesh discovery notes.
const KIND_BUZZ_MESH_MEMBER_STATUS: u16 = 30003;
const MESH_STATUS_D_TAG_PREFIX: &str = "buzz-mesh-member-status:";
const MESH_STATUS_TYPE: &str = "buzz-mesh-status";
fn relay_url() -> String {
std::env::var("RELAY_URL").unwrap_or_else(|_| "ws://localhost:3000".to_string())
}
/// Load a relay identity from an env-provided nsec. Returns `None` (and prints
/// why) when the fixture is absent, so the caller skips rather than running
/// against a `Keys::generate()` identity whose membership is undefined —
/// asserting "member sees status" against a random key is the bug Perci caught.
fn keys_from_env(var: &str) -> Option<Keys> {
match std::env::var(var) {
Ok(nsec) if !nsec.trim().is_empty() => match Keys::parse(nsec.trim()) {
Ok(keys) => Some(keys),
Err(e) => panic!("{var} is set but not a valid nsec/hex secret key: {e}"),
},
_ => {
eprintln!(
"SKIP: {var} not set — provision a relay {} identity and re-run (see module docs)",
if var.contains("MEMBER") {
"member"
} else {
"non-member"
}
);
None
}
}
}
fn sub_id(name: &str) -> String {
format!("e2e-mesh-{name}-{}", uuid::Uuid::new_v4().simple())
}
fn mesh_status_filter() -> Filter {
Filter::new()
.kind(Kind::Custom(KIND_BUZZ_MESH_MEMBER_STATUS))
.custom_tag(SingleLetterTag::lowercase(Alphabet::K), MESH_STATUS_TYPE)
}
/// Assertion 1: an authenticated relay member can read its own client-signed
/// kind:30003 status. The content carries an owner binding and EndpointAddr dial
/// pointers, but no secret keys or local paths.
///
/// Requires a mesh-enabled relay that has published at least one status event.
#[tokio::test]
#[ignore]
async fn trust_member_reads_mesh_status() {
let url = relay_url();
let Some(member) = keys_from_env("MEMBER_NSEC") else {
return;
};
let mut client = BuzzTestClient::connect(&url, &member)
.await
.expect("member connect+auth");
let sid = sub_id("member-read");
client
.subscribe(&sid, vec![mesh_status_filter()])
.await
.expect("subscribe");
let events = client
.collect_until_eose(&sid, Duration::from_secs(10))
.await
.expect("collect");
let status = events
.iter()
.find(|e| {
e.kind == Kind::Custom(KIND_BUZZ_MESH_MEMBER_STATUS) && e.pubkey == member.public_key()
})
.expect("the publishing member must see its kind:30003 mesh status event");
assert_eq!(
status.pubkey,
member.public_key(),
"status must be signed by the desktop member, not the relay"
);
assert!(status.tags.iter().any(|tag| {
let values = tag.as_slice();
values.first().map(String::as_str) == Some("d")
&& values
.get(1)
.is_some_and(|value| value.starts_with(MESH_STATUS_D_TAG_PREFIX))
}));
let content: serde_json::Value =
serde_json::from_str(&status.content).expect("content is JSON");
for field in ["ownerId", "ownerVerifyingKey", "ownerBindingSig"] {
assert!(
content[field]
.as_str()
.is_some_and(|value| !value.trim().is_empty()),
"status carries {field}"
);
}
// Dial pointer present (EndpointAddr is connectivity, not a secret).
let targets = content["serveTargets"]
.as_array()
.expect("serveTargets array");
if let Some(t) = targets.first() {
assert!(
t.get("endpointAddr").is_some(),
"serve target carries its EndpointAddr dial pointer"
);
}
// No secrets / no local-machine leakage in the published projection.
let raw = status.content.to_lowercase();
for forbidden in [
"nsec",
"secret",
"/users/",
"/home/",
"runtime_dir",
"local_path",
] {
assert!(
!raw.contains(forbidden),
"published status must not leak `{forbidden}`"
);
}
client.disconnect().await.ok();
}
/// Assertion 2: a valid Nostr identity that is NOT a relay member gets nothing
/// back for a kind:30003 mesh-status REQ — membership gates the read.
///
/// Requires a relay with `BUZZ_REQUIRE_RELAY_MEMBERSHIP=true` and a published
/// status event that members can see (paired with assertion 1).
#[tokio::test]
#[ignore]
async fn trust_nonmember_read_denied() {
let url = relay_url();
let Some(stranger) = keys_from_env("STRANGER_NSEC") else {
return;
};
let mut client = match BuzzTestClient::connect(&url, &stranger).await {
Ok(c) => c,
// A closed relay may refuse NIP-42 auth for a non-member outright —
// that is also a valid "denied" outcome.
Err(_) => return,
};
let sid = sub_id("stranger-read");
client
.subscribe(&sid, vec![mesh_status_filter()])
.await
.expect("subscribe");
let events = client
.collect_until_eose(&sid, Duration::from_secs(10))
.await
.expect("collect");
let leaked = events
.iter()
.any(|e| e.kind == Kind::Custom(KIND_BUZZ_MESH_MEMBER_STATUS));
assert!(
!leaked,
"non-member must NOT receive kind:30003 mesh status"
);
client.disconnect().await.ok();
}
/// Assertion 4 (the headline demo): with desktop A serving a model and desktop
/// B running a mesh client + a launched buzz-agent pointed at B's local
/// `:9337/v1`, a chat completion returns a non-empty response routed over the
/// mesh to A's GPU.
///
/// This needs two live mesh nodes + a small served model — runbook only, never
/// in default CI. Left as a documented, compiling placeholder so the acceptance
/// matrix is executable code, not prose; wire the live harness when M1 lands.
#[tokio::test]
#[ignore]
async fn live_agent_completes_chat_over_mesh() {
// RUNBOOK (M1 hardware): see module docs.
// A: Share compute → serve a small model. B: mesh client up on :9337.
// Point this test at B's local OpenAI endpoint via MESH_OPENAI_BASE
// (e.g. http://127.0.0.1:9337/v1). When set, we drive a real completion
// over the mesh and assert non-empty output — no endpoint, no silent pass.
let Ok(base) = std::env::var("MESH_OPENAI_BASE") else {
eprintln!(
"SKIP: MESH_OPENAI_BASE not set — needs a live mesh client endpoint (see module docs)"
);
return;
};
let base = base.trim_end_matches('/').to_string();
let http = reqwest::Client::new();
// Resolve the served model id (the node assigns its own, not our ref).
let models: serde_json::Value = http
.get(format!("{base}/models"))
.send()
.await
.expect("GET /models")
.json()
.await
.expect("/models JSON");
let model_id = models["data"][0]["id"]
.as_str()
.expect("at least one model served over the mesh")
.to_string();
let resp: serde_json::Value = http
.post(format!("{base}/chat/completions"))
.json(&serde_json::json!({
"model": model_id,
"messages": [{"role": "user", "content": "Reply with exactly one word: PONG"}],
"max_tokens": 512,
"temperature": 0.0,
}))
.send()
.await
.expect("POST /chat/completions over mesh")
.json()
.await
.expect("completion JSON");
let content = resp["choices"][0]["message"]["content"]
.as_str()
.expect("completion has message content");
assert!(
!content.trim().is_empty(),
"chat completion over the mesh must return non-empty content"
);
}
/// Assertion 6 (split): a model too large for one node + two serve nodes in the
/// same mesh → mesh auto-splits → the same chat (assertion 4) completes via the
/// split route. Auto-split is mesh runtime behavior (no Buzz code); this row
/// only verifies two serve desktops in one mesh produce a working split.
///
/// Runbook only — needs a known too-large-for-one-node fixture + 2 serve nodes.
#[tokio::test]
#[ignore]
async fn live_split_model_completes() {
// RUNBOOK: A + C both serve the oversized model into the same mesh; B's
// agent completes a chat; mesh elects a split topology (>=2 stage participants).
// Genuinely multi-node — cannot be automated single-process. Skips in CI;
// run manually with a real split harness.
println!("SKIP: live_split_model_completes is a manual runbook test — needs 2 serve nodes (see module docs)");
return;
}