You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Implement Localization Accuracy and Real-Time Metrics #759
Implement consistent instrumentation and reporting for localization accuracy, scheduling delay, deadline misses, end-to-end latency, and input data age in the integrated Awkernel localization pipeline. Provide reusable metrics for concurrent replay evaluation and subsequent robustness experiments.
Scope:
Define measurement boundaries and clock mappings for all metrics
Measure position and orientation errors against timestamp-aligned ground truth where available
Measure scheduling delay from task readiness to execution start, distinguishing it from input-release delay and dependency waiting
Detect deadline misses using explicitly defined release times, deadlines, and completion events
Measure per-scan latency from pipeline input availability to the associated NDT result
Track when NDT and gyro odometry measurements are incorporated into EKF outputs
Measure the age of each consumed input from its measurement timestamp to consumption time
Export per-event records and aggregated summaries
Acceptance criteria:
Each metric has a documented definition, unit, clock domain, and applicable task or output.
Trace identifiers associate scans, task executions, measurements, and outputs without relying solely on timestamp proximity.
EKF output latency and freshness are reported separately for relevant input streams rather than attributed to an arbitrary latest scan.
Deadline reports include miss counts, evaluated-job counts, miss ratios, and tardiness; dropped or unfinished jobs are reported separately.
Timing summaries include median, tail percentiles, and maximum observed values with sample counts.
Accuracy reports distinguish ground-truth errors from differences against a reference implementation.
Synthetic traces with known delays and deadline violations validate the metric calculations.
Instrumentation overhead is measured and reported.
Machine-readable results and analysis commands are sufficient to reproduce the summaries.
Out of scope:
Replay workload generation, changes to localization algorithms or scheduling policies, and formal worst-case timing guarantees.
Activity