03 / detailed analysis

Language Quality

The published Language Quality evaluation combines three different kinds of evidence: archived mechanical measurements, judgments under an input-hash-verified design rubric, and aggregate adversarial-case results. The mechanical cache permits exact reconstruction of the performance and resource scores. The committed safety summaries omit individual case verdicts, so those sections explain the scoring rule and the limit on causal attribution. Every Quidra result here describes the historical v0.3.0 benchmark, including certified baseline measurements reused by that run.

Quidra’s evaluation rank
4th of 10
Evaluation score
66.13 / 100

Recorded run · 27 September 2026. These scores evaluate Quidra v0.3.0 at 38b7137. The site’s current compiler release is v0.5.0.

Run 2026-09-27-38b7137-gh31 · Methodology reference · Published score breakdown

Run’s declared inference model: claude-sonnet-5. Any separate review stages in the archived assessments are identified in the evidence notes.

Score records belong to this run; methodology links point to a later source snapshot. Its full template hash differs from the run’s recorded template hash. The explanations distinguish verified rubric inputs and score calculations from missing original observations.

25 requirements / 0–100 scores

Per-requirement comparison

Higher is better in every row. “Best other” is the highest-scoring non-Quidra language for that requirement, with every tie included. Δ is Quidra’s score minus the best other score. Published scores.

Scroll horizontally to see every column.

All 25 Language Quality requirements. Select a requirement to read its evidence.
Requirement Quidra Best other Other score Δ
Native execution performance 63.02 Zig 97.01 −33.99
Long-running performance 61.81 Zig 95.32 −33.51
Compile / build performance 0.60 Python 100.00 −99.40
Startup latency 64.10 Zig 100.00 −35.90
Memory efficiency 75.17 Zig 97.81 −22.64
Source code size 92.32 Python 95.13 −2.81
Binary / artifact size 1.70 Python 100.00 −98.30
Runtime overhead 100.00 Python, Swift 99.72 +0.28
Code efficiency / conciseness 90.00 Kotlin, Swift 95.00 −5.00
Readability 95.00 Go 95.00 0.00
Functionality / expressiveness 85.00 Rust 100.00 −15.00
Diagnostics 100.00 Rust 100.00 0.00
Dependency simplicity 100.00 Rust, Go 100.00 0.00
Portability design / platform neutrality 90.00 Go, Kotlin, Zig 100.00 −10.00
FFI / interoperability design 70.00 Rust 100.00 −30.00
Concurrency 55.00 Swift 100.00 −45.00
Type safety 74.58 Swift, Zig 67.08 +7.50
Memory safety 44.44 Java, Kotlin 100.00 −55.56
Runtime safety 41.67 Python 68.75 −27.08
Boundary value safety 54.55 Python 65.91 −11.36
Adversarial input robustness 50.71 Java 85.71 −35.00
Early error detection 59.81 Java 65.00 −5.19
Debuggability 66.67 Python 68.59 −1.92
Silent bug resistance 91.18 Swift 88.24 +2.94
Implementation robustness 100.00 Python, C++, Go, Java, TypeScript, Kotlin, Swift 100.00 0.00

01 / metric.native_execution_performance

Effective evaluation weight 6.25%

Native execution performance

Cold execution wall time for the eleven prescribed microbenchmark workloads.

How it is measured

Lower values score higher: each score is 100 × the smallest archived value among the ten languages ÷ that language's archived value. Normalize each of MB-01 through MB-11 separately, then take the unweighted arithmetic mean of the eleven scores. Score breakdown · Methodology reference.

The published run reused certified baseline measurements. The archived effective raw values below reproduce its published scores; score ratios are not universal speed or size ratios between languages.

Different languages can be best on different workloads. Each workload has equal score weight, so a very long workload does not dominate the average merely because it takes more seconds.

Quidra

Quidra 0.3.0

63.02 / 100

The eleven workload scores sum to 693.2684. Their unweighted mean is 63.02/100. Every value and corresponding score contribution is shown below.

Its highest contribution is MB05 (Vector inner product), 98.69; its lowest is MB10 (File I/O), 2.22. These measured differences, after workload-by-workload normalization, determine the total.

Recorded evidence
MB01 · Fibonacci 0.322624703 s → 49.19/100
MB02 · Factorial 0.903742375 s → 96.67/100
MB03 · Integer arithmetic 0.835439877 s → 79.80/100
MB04 · Floating-point arithmetic 1.273584335 s → 95.58/100
MB05 · Vector inner product 0.802363732 s → 98.69/100
MB06 · Matrix multiplication 1.212014493 s → 94.32/100
MB07 · Sorting 1.519139783 s → 37.33/100
MB08 · Strings 1.144842039 s → 64.26/100
MB09 · Statistics 0.620016279 s → 52.21/100
MB10 · File I/O 12.492370613 s → 2.22/100
MB11 · Collections 1.311153411 s → 23.00/100

Evidence limits

These raw inputs originated in 2026-09-22-bc3d9dd-gh9 and were reused by the published run. The retained values describe that benchmark configuration and are not a fresh measurement of a later release.

Best other

Zig 0.16.0

97.01 / 100

The eleven workload scores sum to 1,067.0631. Their unweighted mean is 97.01/100. Every value and corresponding score contribution is shown below.

Its highest contribution is MB09 (Statistics), 100.00; its lowest is MB06 (Matrix multiplication), 84.10. These measured differences, after workload-by-workload normalization, determine the total.

Recorded evidence
MB01 · Fibonacci 0.15899027 s → 99.81/100
MB02 · Factorial 0.934564091 s → 93.48/100
MB03 · Integer arithmetic 0.66665487 s → 100.00/100
MB04 · Floating-point arithmetic 1.266328932 s → 96.13/100
MB05 · Vector inner product 0.791892478 s → 100.00/100
MB06 · Matrix multiplication 1.359253506 s → 84.10/100
MB07 · Sorting 0.575190008 s → 98.59/100
MB08 · Strings 0.774822234 s → 94.94/100
MB09 · Statistics 0.323714591 s → 100.00/100
MB10 · File I/O 0.277783035 s → 100.00/100
MB11 · Collections 0.301507801 s → 100.00/100

Evidence limits

These raw inputs originated in 2026-09-22-bc3d9dd-gh9 and were reused by the published run. The retained values describe that benchmark configuration and are not a fresh measurement of a later release.

02 / metric.long_running_performance

Effective evaluation weight 6.25%

Long-running performance

Steady execution time for the same eleven microbenchmark workloads.

How it is measured

Lower values score higher: each score is 100 × the smallest archived value among the ten languages ÷ that language's archived value. Normalize each of MB-01 through MB-11 separately, then take the unweighted arithmetic mean of the eleven scores. Score breakdown · Methodology reference.

The published run reused certified baseline measurements. The archived effective raw values below reproduce its published scores; score ratios are not universal speed or size ratios between languages.

Different languages can be best on different workloads. Each workload has equal score weight, so a very long workload does not dominate the average merely because it takes more seconds.

Quidra

Quidra 0.3.0

61.81 / 100

The eleven workload scores sum to 679.8649. Their unweighted mean is 61.81/100. Every value and corresponding score contribution is shown below.

Its highest contribution is MB05 (Vector inner product), 97.83; its lowest is MB10 (File I/O), 2.18. These measured differences, after workload-by-workload normalization, determine the total.

Recorded evidence
MB01 · Fibonacci 0.320670449 s → 48.98/100
MB02 · Factorial 0.901494642 s → 96.57/100
MB03 · Integer arithmetic 0.832557296 s → 87.17/100
MB04 · Floating-point arithmetic 1.269336885 s → 76.39/100
MB05 · Vector inner product 0.80043783 s → 97.83/100
MB06 · Matrix multiplication 1.216180117 s → 90.61/100
MB07 · Sorting 1.517672859 s → 37.09/100
MB08 · Strings 1.102612685 s → 65.89/100
MB09 · Statistics 0.597755545 s → 53.68/100
MB10 · File I/O 12.73226402 s → 2.18/100
MB11 · Collections 1.270545712 s → 23.48/100

Evidence limits

These raw inputs originated in 2026-09-22-bc3d9dd-gh9 and were reused by the published run. The retained values describe that benchmark configuration and are not a fresh measurement of a later release.

Best other

Zig 0.16.0

95.32 / 100

The eleven workload scores sum to 1,048.4662. Their unweighted mean is 95.32/100. Every value and corresponding score contribution is shown below.

Its highest contribution is MB10 (File I/O), 100.00; its lowest is MB04 (Floating-point arithmetic), 76.70. These measured differences, after workload-by-workload normalization, determine the total.

Recorded evidence
MB01 · Fibonacci 0.157289047 s → 99.86/100
MB02 · Factorial 0.932763001 s → 93.33/100
MB03 · Integer arithmetic 0.734194342 s → 98.85/100
MB04 · Floating-point arithmetic 1.26423498 s → 76.70/100
MB05 · Vector inner product 0.790440052 s → 99.07/100
MB06 · Matrix multiplication 1.328642051 s → 82.94/100
MB07 · Sorting 0.571131932 s → 98.56/100
MB08 · Strings 0.732633483 s → 99.17/100
MB09 · Statistics 0.320876149 s → 100.00/100
MB10 · File I/O 0.277005711 s → 100.00/100
MB11 · Collections 0.29838739 s → 100.00/100

Evidence limits

These raw inputs originated in 2026-09-22-bc3d9dd-gh9 and were reused by the published run. The retained values describe that benchmark configuration and are not a fresh measurement of a later release.

03 / metric.compile_build_performance

Effective evaluation weight 6.25%

Compile / build performance

Build cost, using the archived effective compile-time values that include the runner's calibration shift.

How it is measured

Lower values score higher: each score is 100 × the smallest archived value among the ten languages ÷ that language's archived value. Normalize each of MB-01 through MB-11 separately, then take the unweighted arithmetic mean of the eleven scores. Effective compile seconds already include a spawn-calibration shift, allowing a finite comparison when a language has no separate compilation step. Score breakdown · Methodology reference.

The published run reused certified baseline measurements. The archived effective raw values below reproduce its published scores; score ratios are not universal speed or size ratios between languages.

Different languages can be best on different workloads. Each workload has equal score weight, so a very long workload does not dominate the average merely because it takes more seconds.

Quidra

Quidra 0.3.0

0.60 / 100

The eleven workload scores sum to 6.6448. Their unweighted mean is 0.60/100. Every value and corresponding score contribution is shown below.

Its highest contribution is MB01 (Fibonacci), 0.77; its lowest is MB11 (Collections), 0.11. These measured differences, after workload-by-workload normalization, determine the total.

Recorded evidence
MB01 · Fibonacci 0.129852579 effective s → 0.77/100
MB02 · Factorial 0.132818096 effective s → 0.75/100
MB03 · Integer arithmetic 0.131946884 effective s → 0.76/100
MB04 · Floating-point arithmetic 0.141110106 effective s → 0.71/100
MB05 · Vector inner product 0.136830295 effective s → 0.73/100
MB06 · Matrix multiplication 0.165551805 effective s → 0.60/100
MB07 · Sorting 0.191268508 effective s → 0.52/100
MB08 · Strings 0.212032152 effective s → 0.47/100
MB09 · Statistics 0.166245074 effective s → 0.60/100
MB10 · File I/O 0.161447395 effective s → 0.62/100
MB11 · Collections 0.952304516 effective s → 0.11/100

Evidence limits

These raw inputs originated in 2026-09-22-bc3d9dd-gh9 and were reused by the published run. The retained values describe that benchmark configuration and are not a fresh measurement of a later release.

The retained normalization input is effective compile time. The separate unshifted time and calibration samples are not included in this compact cache record.

Best other

Python 3.12.3

100.00 / 100

The eleven workload scores sum to 1,100. Their unweighted mean is 100.00/100. Every value and corresponding score contribution is shown below.

Its highest contribution is MB01 (Fibonacci), 100.00; its lowest is MB01 (Fibonacci), 100.00. These measured differences, after workload-by-workload normalization, determine the total.

Recorded evidence
MB01 · Fibonacci 0.001 effective s → 100.00/100
MB02 · Factorial 0.001 effective s → 100.00/100
MB03 · Integer arithmetic 0.001 effective s → 100.00/100
MB04 · Floating-point arithmetic 0.001 effective s → 100.00/100
MB05 · Vector inner product 0.001 effective s → 100.00/100
MB06 · Matrix multiplication 0.001 effective s → 100.00/100
MB07 · Sorting 0.001 effective s → 100.00/100
MB08 · Strings 0.001 effective s → 100.00/100
MB09 · Statistics 0.001 effective s → 100.00/100
MB10 · File I/O 0.001 effective s → 100.00/100
MB11 · Collections 0.001 effective s → 100.00/100

Evidence limits

These raw inputs originated in 2026-09-22-bc3d9dd-gh9 and were reused by the published run. The retained values describe that benchmark configuration and are not a fresh measurement of a later release.

The retained normalization input is effective compile time. The separate unshifted time and calibration samples are not included in this compact cache record.

04 / metric.startup_latency

Effective evaluation weight 6.25%

Startup latency

Process-start-to-exit wall time for MB-00, the ordinary program that prints HELLO.

How it is measured

Lower values score higher: each score is 100 × the smallest archived value among the ten languages ÷ that language's archived value. MB-00 supplies the single scored value. Score breakdown · Methodology reference.

The published run reused certified baseline measurements. The archived effective raw values below reproduce its published scores; score ratios are not universal speed or size ratios between languages.

Quidra

Quidra 0.3.0

64.10 / 100

The archived MB-00 value is 0.001946273 s. The cohort minimum is 0.001247468 s, so 100 × 0.001247468 ÷ 0.001946273 = 64.10.

Recorded evidence
MB-00 archived value 0.001946273 s
Cohort minimum 0.001247468 s

Evidence limits

These raw inputs originated in 2026-09-22-bc3d9dd-gh9 and were reused by the published run. The retained values describe that benchmark configuration and are not a fresh measurement of a later release.

Best other

Zig 0.16.0

100.00 / 100

The archived MB-00 value is 0.001247468 s. The cohort minimum is 0.001247468 s, so 100 × 0.001247468 ÷ 0.001247468 = 100.00.

Recorded evidence
MB-00 archived value 0.001247468 s
Cohort minimum 0.001247468 s

Evidence limits

These raw inputs originated in 2026-09-22-bc3d9dd-gh9 and were reused by the published run. The retained values describe that benchmark configuration and are not a fresh measurement of a later release.

05 / metric.memory_efficiency

Effective evaluation weight ≈4.69%

Memory efficiency

Peak resident memory under the eleven microbenchmark workloads.

How it is measured

Lower values score higher: each score is 100 × the smallest archived value among the ten languages ÷ that language's archived value. Normalize each of MB-01 through MB-11 separately, then take the unweighted arithmetic mean of the eleven scores. Score breakdown · Methodology reference.

The published run reused certified baseline measurements. The archived effective raw values below reproduce its published scores; score ratios are not universal speed or size ratios between languages.

Different languages can be best on different workloads. Each workload has equal score weight, so a very long workload does not dominate the average merely because it takes more seconds.

Quidra

Quidra 0.3.0

75.17 / 100

The eleven workload scores sum to 826.8836. Their unweighted mean is 75.17/100. Every value and corresponding score contribution is shown below.

Its highest contribution is MB03 (Integer arithmetic), 100.00; its lowest is MB10 (File I/O), 0.69. These measured differences, after workload-by-workload normalization, determine the total.

Recorded evidence
MB01 · Fibonacci 11,665,408 bytes → 99.68/100
MB02 · Factorial 11,636,736 bytes → 99.79/100
MB03 · Integer arithmetic 11,620,352 bytes → 100.00/100
MB04 · Floating-point arithmetic 11,657,216 bytes → 99.61/100
MB05 · Vector inner product 35,250,176 bytes → 95.28/100
MB06 · Matrix multiplication 11,628,544 bytes → 100.00/100
MB07 · Sorting 67,756,032 bytes → 73.25/100
MB08 · Strings 79,712,256 bytes → 16.75/100
MB09 · Statistics 35,254,272 bytes → 95.24/100
MB10 · File I/O 1,675,689,984 bytes → 0.69/100
MB11 · Collections 77,201,408 bytes → 46.58/100

Evidence limits

These raw inputs originated in 2026-09-22-bc3d9dd-gh9 and were reused by the published run. The retained values describe that benchmark configuration and are not a fresh measurement of a later release.

Best other

Zig 0.16.0

97.81 / 100

The eleven workload scores sum to 1,075.9355. Their unweighted mean is 97.81/100. Every value and corresponding score contribution is shown below.

Its highest contribution is MB05 (Vector inner product), 100.00; its lowest is MB11 (Collections), 76.99. These measured differences, after workload-by-workload normalization, determine the total.

Recorded evidence
MB01 · Fibonacci 11,636,736 bytes → 99.93/100
MB02 · Factorial 11,649,024 bytes → 99.68/100
MB03 · Integer arithmetic 11,653,120 bytes → 99.72/100
MB04 · Floating-point arithmetic 11,644,928 bytes → 99.72/100
MB05 · Vector inner product 33,587,200 bytes → 100.00/100
MB06 · Matrix multiplication 11,636,736 bytes → 99.93/100
MB07 · Sorting 49,631,232 bytes → 100.00/100
MB08 · Strings 13,352,960 bytes → 100.00/100
MB09 · Statistics 33,574,912 bytes → 100.00/100
MB10 · File I/O 11,632,640 bytes → 99.96/100
MB11 · Collections 46,710,784 bytes → 76.99/100

Evidence limits

These raw inputs originated in 2026-09-22-bc3d9dd-gh9 and were reused by the published run. The retained values describe that benchmark configuration and are not a fresh measurement of a later release.

06 / metric.source_code_size

Effective evaluation weight ≈4.69%

Source code size

Source bytes for the eleven equivalent benchmark programs; each workload is normalized separately.

How it is measured

Lower values score higher: each score is 100 × the smallest archived value among the ten languages ÷ that language's archived value. Normalize each of MB-01 through MB-11 separately, then take the unweighted arithmetic mean of the eleven scores. Score breakdown · Methodology reference.

The published run reused certified baseline measurements. The archived effective raw values below reproduce its published scores; score ratios are not universal speed or size ratios between languages.

Different languages can be best on different workloads. Each workload has equal score weight, so a very long workload does not dominate the average merely because it takes more seconds.

Quidra

Quidra 0.3.0

92.32 / 100

The eleven workload scores sum to 1,015.536. Their unweighted mean is 92.32/100. Every value and corresponding score contribution is shown below.

Its highest contribution is MB02 (Factorial), 100.00; its lowest is MB11 (Collections), 76.47. These measured differences, after workload-by-workload normalization, determine the total.

Recorded evidence
MB01 · Fibonacci 971 bytes → 95.37/100
MB02 · Factorial 1,009 bytes → 100.00/100
MB03 · Integer arithmetic 1,404 bytes → 88.46/100
MB04 · Floating-point arithmetic 2,111 bytes → 96.83/100
MB05 · Vector inner product 1,694 bytes → 100.00/100
MB06 · Matrix multiplication 2,051 bytes → 100.00/100
MB07 · Sorting 3,300 bytes → 80.52/100
MB08 · Strings 3,491 bytes → 92.64/100
MB09 · Statistics 3,604 bytes → 87.68/100
MB10 · File I/O 2,810 bytes → 97.58/100
MB11 · Collections 3,557 bytes → 76.47/100

Evidence limits

These raw inputs originated in 2026-09-22-bc3d9dd-gh9 and were reused by the published run. The retained values describe that benchmark configuration and are not a fresh measurement of a later release.

Best other

Python 3.12.3

95.13 / 100

The eleven workload scores sum to 1,046.4657. Their unweighted mean is 95.13/100. Every value and corresponding score contribution is shown below.

Its highest contribution is MB01 (Fibonacci), 100.00; its lowest is MB02 (Factorial), 78.71. These measured differences, after workload-by-workload normalization, determine the total.

Recorded evidence
MB01 · Fibonacci 926 bytes → 100.00/100
MB02 · Factorial 1,282 bytes → 78.71/100
MB03 · Integer arithmetic 1,242 bytes → 100.00/100
MB04 · Floating-point arithmetic 2,044 bytes → 100.00/100
MB05 · Vector inner product 1,833 bytes → 92.42/100
MB06 · Matrix multiplication 2,072 bytes → 98.99/100
MB07 · Sorting 3,018 bytes → 88.04/100
MB08 · Strings 3,468 bytes → 93.25/100
MB09 · Statistics 3,324 bytes → 95.07/100
MB10 · File I/O 2,742 bytes → 100.00/100
MB11 · Collections 2,720 bytes → 100.00/100

Evidence limits

These raw inputs originated in 2026-09-22-bc3d9dd-gh9 and were reused by the published run. The retained values describe that benchmark configuration and are not a fresh measurement of a later release.

07 / metric.binary_artifact_size

Effective evaluation weight ≈4.69%

Binary / artifact size

The archived build-artifact values, including the runner's artifact-size shift.

How it is measured

Lower values score higher: each score is 100 × the smallest archived value among the ten languages ÷ that language's archived value. Normalize each of MB-01 through MB-11 separately, then take the unweighted arithmetic mean of the eleven scores. Effective artifact bytes already include the source runner's 4,096-byte shift. Score breakdown · Methodology reference.

The published run reused certified baseline measurements. The archived effective raw values below reproduce its published scores; score ratios are not universal speed or size ratios between languages.

Different languages can be best on different workloads. Each workload has equal score weight, so a very long workload does not dominate the average merely because it takes more seconds.

Quidra

Quidra 0.3.0

1.70 / 100

The eleven workload scores sum to 18.6774. Their unweighted mean is 1.70/100. Every value and corresponding score contribution is shown below.

Its highest contribution is MB02 (Factorial), 1.77; its lowest is MB11 (Collections), 1.40. These measured differences, after workload-by-workload normalization, determine the total.

Recorded evidence
MB01 · Fibonacci 230,976 effective bytes → 1.77/100
MB02 · Factorial 230,824 effective bytes → 1.77/100
MB03 · Integer arithmetic 230,912 effective bytes → 1.77/100
MB04 · Floating-point arithmetic 235,792 effective bytes → 1.74/100
MB05 · Vector inner product 235,704 effective bytes → 1.74/100
MB06 · Matrix multiplication 235,792 effective bytes → 1.74/100
MB07 · Sorting 235,688 effective bytes → 1.74/100
MB08 · Strings 249,368 effective bytes → 1.64/100
MB09 · Statistics 235,880 effective bytes → 1.74/100
MB10 · File I/O 252,168 effective bytes → 1.62/100
MB11 · Collections 292,056 effective bytes → 1.40/100

Evidence limits

These raw inputs originated in 2026-09-22-bc3d9dd-gh9 and were reused by the published run. The retained values describe that benchmark configuration and are not a fresh measurement of a later release.

Best other

Python 3.12.3

100.00 / 100

The eleven workload scores sum to 1,100. Their unweighted mean is 100.00/100. Every value and corresponding score contribution is shown below.

Its highest contribution is MB01 (Fibonacci), 100.00; its lowest is MB01 (Fibonacci), 100.00. These measured differences, after workload-by-workload normalization, determine the total.

Recorded evidence
MB01 · Fibonacci 4,096 effective bytes → 100.00/100
MB02 · Factorial 4,096 effective bytes → 100.00/100
MB03 · Integer arithmetic 4,096 effective bytes → 100.00/100
MB04 · Floating-point arithmetic 4,096 effective bytes → 100.00/100
MB05 · Vector inner product 4,096 effective bytes → 100.00/100
MB06 · Matrix multiplication 4,096 effective bytes → 100.00/100
MB07 · Sorting 4,096 effective bytes → 100.00/100
MB08 · Strings 4,096 effective bytes → 100.00/100
MB09 · Statistics 4,096 effective bytes → 100.00/100
MB10 · File I/O 4,096 effective bytes → 100.00/100
MB11 · Collections 4,096 effective bytes → 100.00/100

Evidence limits

These raw inputs originated in 2026-09-22-bc3d9dd-gh9 and were reused by the published run. The retained values describe that benchmark configuration and are not a fresh measurement of a later release.

08 / metric.runtime_overhead

Effective evaluation weight ≈4.69%

Runtime overhead

Baseline resident memory for MB-00, separate from memory consumed by substantive workloads.

How it is measured

Lower values score higher: each score is 100 × the smallest archived value among the ten languages ÷ that language's archived value. MB-00 supplies the single scored value. Score breakdown · Methodology reference.

The published run reused certified baseline measurements. The archived effective raw values below reproduce its published scores; score ratios are not universal speed or size ratios between languages.

Quidra

Quidra 0.3.0

100.00 / 100

The archived MB-00 value is 11,612,160 bytes. The cohort minimum is 11,612,160 bytes, so 100 × 11,612,160 ÷ 11,612,160 = 100.00.

Recorded evidence
MB-00 archived value 11,612,160 bytes
Cohort minimum 11,612,160 bytes

Evidence limits

These raw inputs originated in 2026-09-22-bc3d9dd-gh9 and were reused by the published run. The retained values describe that benchmark configuration and are not a fresh measurement of a later release.

Best other · 2 tied languages

Python 3.12.3

99.72 / 100

The archived MB-00 value is 11,644,928 bytes. The cohort minimum is 11,612,160 bytes, so 100 × 11,612,160 ÷ 11,644,928 = 99.72.

Recorded evidence
MB-00 archived value 11,644,928 bytes
Cohort minimum 11,612,160 bytes

Evidence limits

These raw inputs originated in 2026-09-22-bc3d9dd-gh9 and were reused by the published run. The retained values describe that benchmark configuration and are not a fresh measurement of a later release.

09 / metric.code_efficiency_conciseness

Effective evaluation weight ≈3.13%

Code efficiency / conciseness

The mandatory ceremony needed to express ordinary programs, judged separately from measured source bytes.

How it is measured

Five equally weighted components are each assigned a judgment level from 0 to 4. The trusted runner converts each level to 0, 5, 10, 15 or 20 points and sums the five contributions. Judge intrinsic mandatory ceremony for the same kinds of ordinary programs. Do not reuse raw LOC/bytes/tokens as the score and do not reward external libraries. Score breakdown · Methodology reference.

The difference is the sum of the recorded component-level differences, multiplied by five. A tie means equal published rubric totals; the underlying findings can differ.

These are rubric judgments about the historical implementations. They are distinct from timed workloads, safety-case execution and ecosystem maturity.

Quidra

Quidra 0.3.0

90.00 / 100

The recorded levels are 4 + 4 + 3 + 3 + 4 = 18 out of 20 level units. The runner's conversion gives 18 × 5 = 90.00/100.

Recorded judgment for Declaration ceremony, Control data ceremony, Abstraction ceremony, Error resource ceremony, Semantic work ratio: Quidra v0.3.0 in this benchmark uses indentation blocks without braces/semicolons, local auto inference and concise range/collection forms while keeping typed boundaries and explicit error/resource semantics; generic/class/error handling retains deliberate bounded ceremony.

Recorded evidence
Declaration ceremony Level 4/4 → 20/20 points
Control data ceremony Level 4/4 → 20/20 points
Abstraction ceremony Level 3/4 → 15/20 points
Error resource ceremony Level 3/4 → 15/20 points
Semantic work ratio Level 4/4 → 20/20 points

Evidence limits

Quidra v0.3.0 in this benchmark judgments are valid only for the exact compiler/runtime plus docs/tests identities frozen in this snapshot; relevant target changes must miss.

The retained design judgment was recertified with GPT-5.6 Sol; the record explicitly claims no new Anthropic/Sonnet call for that reconstruction.

Best other · 2 tied languages

Kotlin 2.3.21

95.00 / 100

The recorded levels are 4 + 4 + 4 + 3 + 4 = 19 out of 20 level units. The runner's conversion gives 19 × 5 = 95.00/100.

Recorded judgment for Declaration ceremony, Control data ceremony, Abstraction ceremony, Error resource ceremony, Semantic work ratio: No cross-language byte/line-count comparison table was produced in this shard (assigned languages = Kotlin only); comparison is against idiomatic-best-practice expectation for the same frozen algorithm as required by language_quality.md fairness rules, not against a fabricated multi-language corpus. | Qualitative + structural analysis of sampled Kotlin micro-benchmark and adversarial programs under template/programs/kotlin/{micro,adversarial}. Assessed token/line density needed to express the same algorithmic workload relative to idiomatic Kotlin best practices (no artificial verbosity or golfing). | Kotlin's type inference (val/var without explicit types), default/named arguments, single-expression functions, and data classes (e.g.

Recorded evidence
Declaration ceremony Level 4/4 → 20/20 points
Control data ceremony Level 4/4 → 20/20 points
Abstraction ceremony Level 4/4 → 20/20 points
Error resource ceremony Level 3/4 → 15/20 points
Semantic work ratio Level 4/4 → 20/20 points

Evidence limits

Comparison-language reprojection requires the preserved paid source evidence plus the historical program/workload/toolchain inputs to match the then-current shard; mismatches remain misses.

The retained design judgment was recertified with GPT-5.6 Sol; the record explicitly claims no new Anthropic/Sonnet call for that reconstruction.

10 / metric.readability

Effective evaluation weight ≈3.13%

Readability

The clarity of idiomatic source, judged through a fixed rubric rather than a human readability study.

How it is measured

Five equally weighted components are each assigned a judgment level from 0 to 4. The trusted runner converts each level to 0, 5, 10, 15 or 20 points and sums the five contributions. Judge readability of idiomatic code under the frozen corpus and documented syntax/semantics, without inventing human-study results. Score breakdown · Methodology reference.

The difference is the sum of the recorded component-level differences, multiplied by five. A tie means equal published rubric totals; the underlying findings can differ.

These are rubric judgments about the historical implementations. They are distinct from timed workloads, safety-case execution and ecosystem maturity.

Quidra

Quidra 0.3.0

95.00 / 100

The recorded levels are 4 + 4 + 3 + 4 + 4 = 19 out of 20 level units. The runner's conversion gives 19 × 5 = 95.00/100.

Recorded judgment for Local intent visibility, Structural clarity, Consistency regular forms, Name type signal, Control effect traceability: Quidra v0.3.0 in this benchmark makes types, writable aliases (&), control flow and error propagation explicit with low punctuation noise and regular forms; a few language-specific spellings and rules still require familiarity.

Recorded evidence
Local intent visibility Level 4/4 → 20/20 points
Structural clarity Level 4/4 → 20/20 points
Consistency regular forms Level 3/4 → 15/20 points
Name type signal Level 4/4 → 20/20 points
Control effect traceability Level 4/4 → 20/20 points

Evidence limits

Quidra v0.3.0 in this benchmark judgments are valid only for the exact compiler/runtime plus docs/tests identities frozen in this snapshot; relevant target changes must miss.

The retained design judgment was recertified with GPT-5.6 Sol; the record explicitly claims no new Anthropic/Sonnet call for that reconstruction.

Best other

Go 1.26.3

95.00 / 100

The recorded levels are 4 + 4 + 4 + 3 + 4 = 19 out of 20 level units. The runner's conversion gives 19 × 5 = 95.00/100.

Recorded judgment for Local intent visibility, Structural clarity, Consistency regular forms, Name type signal, Control effect traceability: Static inspection of the same Go source corpus for naming clarity, structural regularity, comment density, and syntactic noise. | gofmt-enforced canonical formatting yields uniform layout across all files, a strong readability asset from tooling-enforced single style. | Small function bodies and single level of abstraction per function make control flow easy to trace. | Explicit types everywhere reduce ambiguity for readers at the cost of some verbosity, net positive for numeric code readability. | Clear doc comments precede important functions explaining algorithmic intent. | No operator overloading or macro/metaprogramming; code executes exactly as written with no hidden control flow. | Multiple return values and consistent error-checking idiom aid pattern recognition despite added line count. | Lack of pattern matching/algebraic data types forces if/else and switch dispatch in complex adversarial samples, slightly less readable than exhaustive pattern matches elsewhere.

Recorded evidence
Local intent visibility Level 4/4 → 20/20 points
Structural clarity Level 4/4 → 20/20 points
Consistency regular forms Level 4/4 → 20/20 points
Name type signal Level 3/4 → 15/20 points
Control effect traceability Level 4/4 → 20/20 points

Evidence limits

Comparison-language reprojection requires the preserved paid source evidence plus the historical program/workload/toolchain inputs to match the then-current shard; mismatches remain misses.

The retained design judgment was recertified with GPT-5.6 Sol; the record explicitly claims no new Anthropic/Sonnet call for that reconstruction.

11 / metric.functionality_expressiveness

Effective evaluation weight ≈3.13%

Functionality / expressiveness

The intrinsic ability to model data, compose abstractions and control execution.

How it is measured

Five equally weighted components are each assigned a judgment level from 0 to 4. The trusted runner converts each level to 0, 5, 10, 15 or 20 points and sums the five contributions. Judge intrinsic general-purpose expressive power available in the language/core runtime, not third-party package breadth. Score breakdown · Methodology reference.

The difference is the sum of the recorded component-level differences, multiplied by five. A tie means equal published rubric totals; the underlying findings can differ.

These are rubric judgments about the historical implementations. They are distinct from timed workloads, safety-case execution and ecosystem maturity.

Quidra

Quidra 0.3.0

85.00 / 100

The recorded levels are 4 + 3 + 3 + 4 + 3 = 17 out of 20 level units. The runner's conversion gives 17 × 5 = 85.00/100.

Recorded judgment for Data modeling, Abstraction reuse, Higher order composition, Systems runtime control, Feature composability: then-current docs specify classes, constrained generics, tagged unions, exhaustive match, first-class function values, arbitrary-precision numerics, arrays/tensors, explicit errors, FFI, modules/packages and native/runtime control; dynamic abstraction remains intentionally narrower than the richest peers.

Recorded evidence
Data modeling Level 4/4 → 20/20 points
Abstraction reuse Level 3/4 → 15/20 points
Higher order composition Level 3/4 → 15/20 points
Systems runtime control Level 4/4 → 20/20 points
Feature composability Level 3/4 → 15/20 points

Evidence limits

Quidra v0.3.0 in this benchmark judgments are valid only for the exact compiler/runtime plus docs/tests identities frozen in this snapshot; relevant target changes must miss.

The retained design judgment was recertified with GPT-5.6 Sol; the record explicitly claims no new Anthropic/Sonnet call for that reconstruction.

Best other

Rust 1.95.0

100.00 / 100

The recorded levels are 4 + 4 + 4 + 4 + 4 = 20 out of 20 level units. The runner's conversion gives 20 × 5 = 100.00/100.

Recorded judgment for Data modeling, Abstraction reuse, Higher order composition, Systems runtime control, Feature composability: Qualitative structural review of Rust language surface using template/programs/rust/adversarial and template/programs/rust/micro reference programs (ADV-01..ADV-26, mb00..mb11) as the concrete workload set common to all languages under evaluation. | Rust supports algebraic data types (enums with payload variants), pattern matching with exhaustiveness checking, trait-based polymorphism (static and dynamic dispatch via dyn Trait), generics with trait bounds, closures with capture-by-move/borrow, RAII-based resource management, zero-cost abstractions (iterators compiling to loops), and a strong ownership/borrowing model expressed directly in the type system (e.g.

Recorded evidence
Data modeling Level 4/4 → 20/20 points
Abstraction reuse Level 4/4 → 20/20 points
Higher order composition Level 4/4 → 20/20 points
Systems runtime control Level 4/4 → 20/20 points
Feature composability Level 4/4 → 20/20 points

Evidence limits

Comparison-language reprojection requires the preserved paid source evidence plus the historical program/workload/toolchain inputs to match the then-current shard; mismatches remain misses.

The retained design judgment was recertified with GPT-5.6 Sol; the record explicitly claims no new Anthropic/Sonnet call for that reconstruction.

12 / metric.diagnostics

Effective evaluation weight ≈3.13%

Diagnostics

The language implementation's ability to identify and explain errors with useful, stable diagnostic information.

How it is measured

Five equally weighted components are each assigned a judgment level from 0 to 4. The trusted runner converts each level to 0, 5, 10, 15 or 20 points and sums the five contributions. Judge built-in compiler/checker/runtime diagnostic design from normal language use; do not count external IDE/debugger maturity. Score breakdown · Methodology reference.

The difference is the sum of the recorded component-level differences, multiplied by five. A tie means equal published rubric totals; the underlying findings can differ.

These are rubric judgments about the historical implementations. They are distinct from timed workloads, safety-case execution and ecosystem maturity.

Quidra

Quidra 0.3.0

100.00 / 100

The recorded levels are 4 + 4 + 4 + 4 + 4 = 20 out of 20 level units. The runner's conversion gives 20 × 5 = 100.00/100.

Recorded judgment for Location context, Cause specificity, Expected actual, Machine stability, Actionability: Quidra v0.3.0 in this benchmark diagnostics have stable codes, source spans, structured JSON output, cause-specific messages, bounded recovery and coded runtime failures, directly covering the five frozen diagnostic components.

Recorded evidence
Location context Level 4/4 → 20/20 points
Cause specificity Level 4/4 → 20/20 points
Expected actual Level 4/4 → 20/20 points
Machine stability Level 4/4 → 20/20 points
Actionability Level 4/4 → 20/20 points

Evidence limits

Quidra v0.3.0 in this benchmark judgments are valid only for the exact compiler/runtime plus docs/tests identities frozen in this snapshot; relevant target changes must miss.

The retained design judgment was recertified with GPT-5.6 Sol; the record explicitly claims no new Anthropic/Sonnet call for that reconstruction.

Best other

Rust 1.95.0

100.00 / 100

The recorded levels are 4 + 4 + 4 + 4 + 4 = 20 out of 20 level units. The runner's conversion gives 20 × 5 = 100.00/100.

Recorded judgment for Location context, Cause specificity, Expected actual, Machine stability, Actionability: rustc via rustup lacked a default toolchain in this sandbox and 'rustup default stable' is not in the permitted executable allowlist, preventing a fresh compiler-output capture for this run. | Direct compiler invocation attempted (rustc test_diag.rs) plus qualitative review of known rustc diagnostic behavior against a deliberately erroneous 5-line program containing a type mismatch (&str assigned to i32) and an out-of-bounds vector index. | Toolchain execution note: the sandbox's rustc is a rustup shim with no default toolchain configured, and 'rustup' is outside the allowed executable list, so direct compiler invocation in this sandbox returned an infrastructure error ('rustup could not choose a version of rustc to run') rather than a language diagnostic.

Recorded evidence
Location context Level 4/4 → 20/20 points
Cause specificity Level 4/4 → 20/20 points
Expected actual Level 4/4 → 20/20 points
Machine stability Level 4/4 → 20/20 points
Actionability Level 4/4 → 20/20 points

Evidence limits

Comparison-language reprojection requires the preserved paid source evidence plus the historical program/workload/toolchain inputs to match the then-current shard; mismatches remain misses.

The retained design judgment was recertified with GPT-5.6 Sol; the record explicitly claims no new Anthropic/Sonnet call for that reconstruction.

13 / metric.dependency_simplicity

Effective evaluation weight ≈3.13%

Dependency simplicity

The explicitness and predictability of module and dependency semantics.

How it is measured

Five equally weighted components are each assigned a judgment level from 0 to 4. The trusted runner converts each level to 0, 5, 10, 15 or 20 points and sums the five contributions. Judge language/module dependency semantics and intrinsic project dependency model. Registry size, package-manager maturity and community conventions belong to Ecosystem. Score breakdown · Methodology reference.

The difference is the sum of the recorded component-level differences, multiplied by five. A tie means equal published rubric totals; the underlying findings can differ.

These are rubric judgments about the historical implementations. They are distinct from timed workloads, safety-case execution and ecosystem maturity.

Quidra

Quidra 0.3.0

100.00 / 100

The recorded levels are 4 + 4 + 4 + 4 + 4 = 20 out of 20 level units. The runner's conversion gives 20 × 5 = 100.00/100.

Recorded judgment for Module import model, Resolution determinism, Dependency declaration, Isolation namespacing, Transitive visibility: then-current import/package semantics distinguish quoted local imports from installed packages, reject cycles, control re-exports, resolve exact stable release tags and lock transitive content hashes, making visibility and resolution explicit.

Recorded evidence
Module import model Level 4/4 → 20/20 points
Resolution determinism Level 4/4 → 20/20 points
Dependency declaration Level 4/4 → 20/20 points
Isolation namespacing Level 4/4 → 20/20 points
Transitive visibility Level 4/4 → 20/20 points

Evidence limits

Quidra v0.3.0 in this benchmark judgments are valid only for the exact compiler/runtime plus docs/tests identities frozen in this snapshot; relevant target changes must miss.

The retained design judgment was recertified with GPT-5.6 Sol; the record explicitly claims no new Anthropic/Sonnet call for that reconstruction.

Best other · 2 tied languages

Rust 1.95.0

100.00 / 100

The recorded levels are 4 + 4 + 4 + 4 + 4 = 20 out of 20 level units. The runner's conversion gives 20 × 5 = 100.00/100.

Recorded judgment for Module import model, Resolution determinism, Dependency declaration, Isolation namespacing, Transitive visibility: Assessment of language-level dependency semantics for Rust, independent of Cargo ecosystem maturity (which belongs to Ecosystem evaluation). | Rust programs reviewed under /quidra-benchmark/template/programs/rust/micro (mb00.rs through mb11.rs) are self-contained, relying only on the Rust standard library (std::collections, std::io, std::fmt, etc.) with no external crate dependencies required for core micro-benchmark logic. | Rust's module system (mod, use, pub) provides explicit, unambiguous dependency declaration at the language level: every external symbol used must be explicitly brought into scope via use, and crate dependencies are declared once in Cargo.toml with semantic versioning enforced by Cargo.lock rather than manual header/linker bookkeeping. | No global mutable namespace pollution: Rust has no implicit global includes or preprocessor-based conditional dependency inclusion (unlike C/C++ #include and #ifdef chains), reducing accidental coupling. | Cargo's dependency resolution is deterministic and reproducible via…

Recorded evidence
Module import model Level 4/4 → 20/20 points
Resolution determinism Level 4/4 → 20/20 points
Dependency declaration Level 4/4 → 20/20 points
Isolation namespacing Level 4/4 → 20/20 points
Transitive visibility Level 4/4 → 20/20 points

Evidence limits

Comparison-language reprojection requires the preserved paid source evidence plus the historical program/workload/toolchain inputs to match the then-current shard; mismatches remain misses.

The retained design judgment was recertified with GPT-5.6 Sol; the record explicitly claims no new Anthropic/Sonnet call for that reconstruction.

14 / metric.portability_design_platform_neutrality

Effective evaluation weight ≈3.13%

Portability design / platform neutrality

Whether the language's design supports portable source and explicit platform boundaries.

How it is measured

Five equally weighted components are each assigned a judgment level from 0 to 4. The trusted runner converts each level to 0, 5, 10, 15 or 20 points and sums the five contributions. Judge the language/runtime design for writing portable source. Actual number of at the recorded snapshot implemented targets belongs to Ecosystem. Score breakdown · Methodology reference.

The difference is the sum of the recorded component-level differences, multiplied by five. A tie means equal published rubric totals; the underlying findings can differ.

These are rubric judgments about the historical implementations. They are distinct from timed workloads, safety-case execution and ecosystem maturity.

Quidra

Quidra 0.3.0

90.00 / 100

The recorded levels are 4 + 3 + 4 + 3 + 4 = 18 out of 20 level units. The runner's conversion gives 18 × 5 = 90.00/100.

Recorded judgment for Specified core semantics, Platform abstraction, Data numeric portability, Conditional platform mechanism, Artifact source separation: then-current architecture keeps semantics in the frontend and typed IR, treats LLVM as an implementation target, specifies numeric/storage semantics independently of host details and centralizes platform declarations; platform abstraction/conditional mechanisms remain less complete than the strongest mature multi-target designs.

Recorded evidence
Specified core semantics Level 4/4 → 20/20 points
Platform abstraction Level 3/4 → 15/20 points
Data numeric portability Level 4/4 → 20/20 points
Conditional platform mechanism Level 3/4 → 15/20 points
Artifact source separation Level 4/4 → 20/20 points

Evidence limits

Quidra v0.3.0 in this benchmark judgments are valid only for the exact compiler/runtime plus docs/tests identities frozen in this snapshot; relevant target changes must miss.

The retained design judgment was recertified with GPT-5.6 Sol; the record explicitly claims no new Anthropic/Sonnet call for that reconstruction.

Best other · 3 tied languages

Go 1.26.3

100.00 / 100

The recorded levels are 4 + 4 + 4 + 4 + 4 = 20 out of 20 level units. The runner's conversion gives 20 × 5 = 100.00/100.

Recorded judgment for Specified core semantics, Platform abstraction, Data numeric portability, Conditional platform mechanism, Artifact source separation: Assessed via static inspection of provided sample sources and documented Go toolchain/language design; did not execute cross-compilation in this sandbox session. | Static language-design analysis of Go's cross-platform build model and inspection of sampled program sources for OS/architecture-specific constructs. | Sampled sources (mb00..mb11) use only standard, platform-neutral packages (fmt, math, time, sync); no cgo, no syscall-specific code, no OS-gated build tags. | Go toolchain supports first-party cross-compilation to dozens of GOOS/GOARCH targets from a single host via env vars understood by the compiler itself -- a language/toolchain design property. | Language spec and runtime (goroutine scheduler, GC, memory model) abstract OS differences uniformly; only explicit syscall/cgo use introduces platform coupling, none present in samples. | Static linking by default (CGO_ENABLED=0) reduces dynamic-library coupling to host distributions.

Recorded evidence
Specified core semantics Level 4/4 → 20/20 points
Platform abstraction Level 4/4 → 20/20 points
Data numeric portability Level 4/4 → 20/20 points
Conditional platform mechanism Level 4/4 → 20/20 points
Artifact source separation Level 4/4 → 20/20 points

Evidence limits

Comparison-language reprojection requires the preserved paid source evidence plus the historical program/workload/toolchain inputs to match the then-current shard; mismatches remain misses.

The retained design judgment was recertified with GPT-5.6 Sol; the record explicitly claims no new Anthropic/Sonnet call for that reconstruction.

15 / metric.ffi_interoperability_design

Effective evaluation weight ≈3.13%

FFI / interoperability design

How the language declares, controls and checks foreign-interface boundaries.

How it is measured

Five equally weighted components are each assigned a judgment level from 0 to 4. The trusted runner converts each level to 0, 5, 10, 15 or 20 points and sums the five contributions. Judge intrinsic FFI/ABI boundary design, not breadth of existing third-party bindings (Ecosystem). Score breakdown · Methodology reference.

The difference is the sum of the recorded component-level differences, multiplied by five. A tie means equal published rubric totals; the underlying findings can differ.

These are rubric judgments about the historical implementations. They are distinct from timed workloads, safety-case execution and ecosystem maturity.

Quidra

Quidra 0.3.0

70.00 / 100

The recorded levels are 3 + 3 + 2 + 3 + 3 = 14 out of 20 level units. The runner's conversion gives 14 × 5 = 70.00/100.

Recorded judgment for Foreign declaration, ABI calling control, Type layout mapping, Ownership lifetime boundary, Bidirectional callbacks: Quidra v0.3.0 in this benchmark documents explicit extern C declarations, FFI-specific diagnostics, a restricted ABI-safe scalar/string/bin/callback subset, reference restrictions and symbol-conflict checks; aggregate layout coverage and broader ABI/callback surface remain intentionally limited.

Recorded evidence
Foreign declaration Level 3/4 → 15/20 points
ABI calling control Level 3/4 → 15/20 points
Type layout mapping Level 2/4 → 10/20 points
Ownership lifetime boundary Level 3/4 → 15/20 points
Bidirectional callbacks Level 3/4 → 15/20 points

Evidence limits

Quidra v0.3.0 in this benchmark judgments are valid only for the exact compiler/runtime plus docs/tests identities frozen in this snapshot; relevant target changes must miss.

The retained design judgment was recertified with GPT-5.6 Sol; the record explicitly claims no new Anthropic/Sonnet call for that reconstruction.

Best other

Rust 1.95.0

100.00 / 100

The recorded levels are 4 + 4 + 4 + 4 + 4 = 20 out of 20 level units. The runner's conversion gives 20 × 5 = 100.00/100.

Recorded judgment for Foreign declaration, ABI calling control, Type layout mapping, Ownership lifetime boundary, Bidirectional callbacks: Rust provides a stable, zero-cost extern "C" FFI mechanism directly in the language, with #[repr(C)] for controlling struct layout to match C ABI exactly. | unsafe blocks explicitly and locally scope the parts of code that cross the safety boundary into foreign code, keeping the rest of the program's soundness guarantees intact and auditable. | Bidirectional FFI is supported: Rust can call into C libraries (via extern "C" { fn ... } declarations and linking) and can also export Rust functions to C callers (via #[no_mangle] pub extern "C" fn). | No garbage collector or runtime is required to call/be called from C, unlike managed languages (Java/Kotlin JNI, Go cgo) that must cross a runtime boundary with extra marshalling and GC-interaction concerns. | Ownership/borrowing rules extend conceptually across FFI: raw pointers (*const T, *mut T) are the FFI currency, and the type system still helps callers reason about aliasing even though the compiler cannot enforce Rust's guarantees across the boundary. | bindgen and cbindgen (ecosystem…

Recorded evidence
Foreign declaration Level 4/4 → 20/20 points
ABI calling control Level 4/4 → 20/20 points
Type layout mapping Level 4/4 → 20/20 points
Ownership lifetime boundary Level 4/4 → 20/20 points
Bidirectional callbacks Level 4/4 → 20/20 points

Evidence limits

Comparison-language reprojection requires the preserved paid source evidence plus the historical program/workload/toolchain inputs to match the then-current shard; mismatches remain misses.

The retained design judgment was recertified with GPT-5.6 Sol; the record explicitly claims no new Anthropic/Sonnet call for that reconstruction.

16 / metric.concurrency

Effective evaluation weight ≈3.13%

Concurrency

The language and core runtime's parallelism, task structure, coordination and error propagation.

How it is measured

Five equally weighted components are each assigned a judgment level from 0 to 4. The trusted runner converts each level to 0, 5, 10, 15 or 20 points and sums the five contributions. Judge intrinsic concurrency/parallelism semantics and core runtime primitives. External frameworks and debugger/tool maturity are out of scope. Score breakdown · Methodology reference.

The difference is the sum of the recorded component-level differences, multiplied by five. A tie means equal published rubric totals; the underlying findings can differ.

These are rubric judgments about the historical implementations. They are distinct from timed workloads, safety-case execution and ecosystem maturity.

Quidra

Quidra 0.3.0

55.00 / 100

The recorded levels are 3 + 2 + 2 + 3 + 1 = 11 out of 20 level units. The runner's conversion gives 11 × 5 = 55.00/100.

Recorded judgment for Parallel execution, Async structured, Synchronization channels, Race safety, Error cancel propagation: Quidra v0.3.0 in this benchmark provides bounded structured task.all execution, ordered scalar result transfer, atomic.Counter shared state and explicit GPU asynchronous execution/synchronization; general cancellation, channels/actors and broad synchronization remain limited.

Recorded evidence
Parallel execution Level 3/4 → 15/20 points
Async structured Level 2/4 → 10/20 points
Synchronization channels Level 2/4 → 10/20 points
Race safety Level 3/4 → 15/20 points
Error cancel propagation Level 1/4 → 5/20 points

Evidence limits

Quidra v0.3.0 in this benchmark judgments are valid only for the exact compiler/runtime plus docs/tests identities frozen in this snapshot; relevant target changes must miss.

The retained design judgment was recertified with GPT-5.6 Sol; the record explicitly claims no new Anthropic/Sonnet call for that reconstruction.

Best other

Swift 6.2.3

100.00 / 100

The recorded levels are 4 + 4 + 4 + 4 + 4 = 20 out of 20 level units. The runner's conversion gives 20 × 5 = 100.00/100.

Recorded judgment for Parallel execution, Async structured, Synchronization channels, Race safety, Error cancel propagation: Swift's concurrency design (structured concurrency + actors + compile-time Sendable/data-race checking) is one of the more advanced and safety-oriented concurrency designs among mainstream languages, comparable in ambition to Rust's ownership-based concurrency safety but achieved with less ceremony, though the ecosystem-wide transition to strict concurrency is still incomplete (an ecosystem/maturity concern excluded here). | Swift | Swift has a modern, language-integrated structured concurrency model (async/await, Task, TaskGroup, AsyncSequence) introduced in Swift 5.5, built into the compiler and standard library rather than bolted on as a library. | Actors provide a language-level data-race-avoidance primitive: actor-isolated state is checked at compile time, preventing many classes of shared-mutable-state races without runtime locks in common cases. | Sendable checking and strict concurrency checking (progressively enforced, mandatory by default in Swift 6 language mode) give compile-time diagnostics for data races crossing…

Recorded evidence
Parallel execution Level 4/4 → 20/20 points
Async structured Level 4/4 → 20/20 points
Synchronization channels Level 4/4 → 20/20 points
Race safety Level 4/4 → 20/20 points
Error cancel propagation Level 4/4 → 20/20 points

Evidence limits

Comparison-language reprojection requires the preserved paid source evidence plus the historical program/workload/toolchain inputs to match the then-current shard; mismatches remain misses.

The retained design judgment was recertified with GPT-5.6 Sol; the record explicitly claims no new Anthropic/Sonnet call for that reconstruction.

17 / metric.type_safety

Effective evaluation weight ≈3.47%

Type safety

Interception of six type hazards, with additional credit for guarantees established before execution.

How it is measured

Score = 0.5 × TS_stage + 0.5 × TS_static. TS_stage averages detection-stage credit across six equally weighted hazards; TS_static is 100 times the hazard-weighted fraction prevented by construction, rejected at compile time, or checked before execution. The prescribed set has eight case-variant rows. Score breakdown · Methodology reference.

The committed run records preserve aggregate mechanical scores and identify the raw workspace artifact, but do not include the per-case verdicts, applicability counts or diagnostic text. The calculation can be described; a claim that a named failing case caused the gap cannot be verified from these retained records.

The source-snapshot detection ladder assigns 100 to compile-time detection or prevention by construction, 90 to static checking before execution, 75 to safe runtime detection, 55 to test failure, 40 to output verification, 20 to a crash, 5 to undefined behavior and 0 to a silent bug. Several safety metrics reuse this evidence with different formulas.

Quidra

Quidra 0.3.0

74.58 / 100

The retained runner result assigns 74.58 under the equal blend of type-hazard stage credit and static-guarantee coverage. It does not preserve the separate TS_stage and TS_static values, so the share of this score attributable to each component cannot be recovered from the committed summary.

Recorded evidence
Published mechanical score 74.58/100
Programs identified by the evidence record 37
Prescribed type-hazard set 6 hazards · 8 case-variant rows · 50% stage / 50% static

Evidence limits

Per-case raw observations are referenced by artifact path and hash, but are not embedded in the committed evidence. Case-level causal claims and exact applicable denominators are therefore unavailable here.

Best other · 2 tied languages

Swift 6.2.3

67.08 / 100

The retained runner result assigns 67.08 under the equal blend of type-hazard stage credit and static-guarantee coverage. It does not preserve the separate TS_stage and TS_static values, so the share of this score attributable to each component cannot be recovered from the committed summary.

Recorded evidence
Published mechanical score 67.08/100
Programs identified by the evidence record 37
Prescribed type-hazard set 6 hazards · 8 case-variant rows · 50% stage / 50% static

Evidence limits

Per-case raw observations are referenced by artifact path and hash, but are not embedded in the committed evidence. Case-level causal claims and exact applicable denominators are therefore unavailable here.

18 / metric.memory_safety

Effective evaluation weight ≈3.47%

Memory safety

The integrity-preservation rate on nine prescribed storage hazards.

How it is measured

Score = 100 × mean(integrity-preserved indicator), first averaging variants within each hazard, then giving the nine hazards equal weight. Prevention, compile-time detection, pre-execution checking and safe runtime detection receive 1; other outcomes receive 0. The prescribed set has eleven case-variant rows. Score breakdown · Methodology reference.

The committed run records preserve aggregate mechanical scores and identify the raw workspace artifact, but do not include the per-case verdicts, applicability counts or diagnostic text. The calculation can be described; a claim that a named failing case caused the gap cannot be verified from these retained records.

The source-snapshot detection ladder assigns 100 to compile-time detection or prevention by construction, 90 to static checking before execution, 75 to safe runtime detection, 55 to test failure, 40 to output verification, 20 to a crash, 5 to undefined behavior and 0 to a silent bug. Several safety metrics reuse this evidence with different formulas.

Quidra

Quidra 0.3.0

44.44 / 100

The published integrity-preservation rate is 44.44%. The formula rewards the implementation's intervention on storage hazards, including safe runtime diagnosis; an uncontrolled crash receives no integrity-preservation credit. The compact evidence does not identify which hazards received credit.

Recorded evidence
Published mechanical score 44.44/100
Programs identified by the evidence record 37
Prescribed storage-hazard set 9 equally weighted hazards · 11 case-variant rows

Evidence limits

Per-case raw observations are referenced by artifact path and hash, but are not embedded in the committed evidence. Case-level causal claims and exact applicable denominators are therefore unavailable here.

Best other · 2 tied languages

Java 26.0.1

100.00 / 100

The published integrity-preservation rate is 100.00%. The formula rewards the implementation's intervention on storage hazards, including safe runtime diagnosis; an uncontrolled crash receives no integrity-preservation credit. The compact evidence does not identify which hazards received credit.

Recorded evidence
Published mechanical score 100.00/100
Programs identified by the evidence record 37
Prescribed storage-hazard set 9 equally weighted hazards · 11 case-variant rows

Evidence limits

Per-case raw observations are referenced by artifact path and hash, but are not embedded in the committed evidence. Case-level causal claims and exact applicable denominators are therefore unavailable here.

19 / metric.runtime_safety

Effective evaluation weight ≈3.47%

Runtime safety

The fraction of scored row-weight reaching execution that was prevented by construction or safely diagnosed at runtime.

How it is measured

Score = 100 × safe runtime/prevented row-weight ÷ row-weight that reaches execution. Compile-time and pre-execution rejections leave the denominator; sub-programs share their row's weight. The source scorer assigns 100 when applicable rows exist but none reaches execution. Score breakdown · Methodology reference.

The denominator depends on how much was rejected before execution. The compact run record omits that denominator and its low-sample flag, which limits direct comparison of these percentages.

The committed run records preserve aggregate mechanical scores and identify the raw workspace artifact, but do not include the per-case verdicts, applicability counts or diagnostic text. The calculation can be described; a claim that a named failing case caused the gap cannot be verified from these retained records.

The source-snapshot detection ladder assigns 100 to compile-time detection or prevention by construction, 90 to static checking before execution, 75 to safe runtime detection, 55 to test failure, 40 to output verification, 20 to a crash, 5 to undefined behavior and 0 to a silent bug. Several safety metrics reuse this evidence with different formulas.

Quidra

Quidra 0.3.0

41.67 / 100

The runner reports 41.67% safe-or-prevented row-weight among the applicable weight reaching execution. The retained result omits the numerator and denominator, so this percentage cannot establish how many cases reached runtime or which checks account for it.

Recorded evidence
Published mechanical score 41.67/100
Programs identified by the evidence record 37

Evidence limits

Per-case raw observations are referenced by artifact path and hash, but are not embedded in the committed evidence. Case-level causal claims and exact applicable denominators are therefore unavailable here.

Best other

Python 3.12.3

68.75 / 100

The runner reports 68.75% safe-or-prevented row-weight among the applicable weight reaching execution. The retained result omits the numerator and denominator, so this percentage cannot establish how many cases reached runtime or which checks account for it.

Recorded evidence
Published mechanical score 68.75/100
Programs identified by the evidence record 37

Evidence limits

Per-case raw observations are referenced by artifact path and hash, but are not embedded in the committed evidence. Case-level causal claims and exact applicable denominators are therefore unavailable here.

20 / metric.boundary_value_safety

Effective evaluation weight ≈3.47%

Boundary value safety

Detection-stage credit on eleven numeric and index-boundary hazards.

How it is measured

Score = the mean detection-stage credit across ADV-01 through ADV-10 and ADV-24. Variants and sub-programs are averaged within a case before the eleven cases receive equal weight. Score breakdown · Methodology reference.

The committed run records preserve aggregate mechanical scores and identify the raw workspace artifact, but do not include the per-case verdicts, applicability counts or diagnostic text. The calculation can be described; a claim that a named failing case caused the gap cannot be verified from these retained records.

The source-snapshot detection ladder assigns 100 to compile-time detection or prevention by construction, 90 to static checking before execution, 75 to safe runtime detection, 55 to test failure, 40 to output verification, 20 to a crash, 5 to undefined behavior and 0 to a silent bug. Several safety metrics reuse this evidence with different formulas.

Quidra

Quidra 0.3.0

54.55 / 100

The recorded 54.55 is detection-stage credit averaged over the applicable cases in the prescribed 11-hazard set. More prevention or earlier diagnosis earns more credit, while crashes and plausible wrong results earn less. The per-case stages needed to identify this language's particular contributing failures were not retained in the repository summary.

Recorded evidence
Published mechanical score 54.55/100
Programs identified by the evidence record 37
Prescribed equally weighted hazard set 11

Evidence limits

Per-case raw observations are referenced by artifact path and hash, but are not embedded in the committed evidence. Case-level causal claims and exact applicable denominators are therefore unavailable here.

Best other

Python 3.12.3

65.91 / 100

The recorded 65.91 is detection-stage credit averaged over the applicable cases in the prescribed 11-hazard set. More prevention or earlier diagnosis earns more credit, while crashes and plausible wrong results earn less. The per-case stages needed to identify this language's particular contributing failures were not retained in the repository summary.

Recorded evidence
Published mechanical score 65.91/100
Programs identified by the evidence record 37
Prescribed equally weighted hazard set 11

Evidence limits

Per-case raw observations are referenced by artifact path and hash, but are not embedded in the committed evidence. Case-level causal claims and exact applicable denominators are therefore unavailable here.

21 / metric.adversarial_input_robustness

Effective evaluation weight ≈3.47%

Adversarial input robustness

Detection-stage credit on seven hazards supplied through external input or unbounded resource demand.

How it is measured

Score = the mean detection-stage credit across ADV-11, ADV-19, ADV-20, ADV-21, ADV-22, ADV-23 and ADV-25, giving each of these seven cases equal weight after within-case averaging. Score breakdown · Methodology reference.

The committed run records preserve aggregate mechanical scores and identify the raw workspace artifact, but do not include the per-case verdicts, applicability counts or diagnostic text. The calculation can be described; a claim that a named failing case caused the gap cannot be verified from these retained records.

The source-snapshot detection ladder assigns 100 to compile-time detection or prevention by construction, 90 to static checking before execution, 75 to safe runtime detection, 55 to test failure, 40 to output verification, 20 to a crash, 5 to undefined behavior and 0 to a silent bug. Several safety metrics reuse this evidence with different formulas.

Quidra

Quidra 0.3.0

50.71 / 100

The recorded 50.71 is detection-stage credit averaged over the applicable cases in the prescribed 7-hazard set. More prevention or earlier diagnosis earns more credit, while crashes and plausible wrong results earn less. The per-case stages needed to identify this language's particular contributing failures were not retained in the repository summary.

Recorded evidence
Published mechanical score 50.71/100
Programs identified by the evidence record 37
Prescribed equally weighted hazard set 7

Evidence limits

Per-case raw observations are referenced by artifact path and hash, but are not embedded in the committed evidence. Case-level causal claims and exact applicable denominators are therefore unavailable here.

Best other

Java 26.0.1

85.71 / 100

The recorded 85.71 is detection-stage credit averaged over the applicable cases in the prescribed 7-hazard set. More prevention or earlier diagnosis earns more credit, while crashes and plausible wrong results earn less. The per-case stages needed to identify this language's particular contributing failures were not retained in the repository summary.

Recorded evidence
Published mechanical score 85.71/100
Programs identified by the evidence record 37
Prescribed equally weighted hazard set 7

Evidence limits

Per-case raw observations are referenced by artifact path and hash, but are not embedded in the committed evidence. Case-level causal claims and exact applicable denominators are therefore unavailable here.

22 / metric.early_error_detection

Effective evaluation weight ≈3.47%

Early error detection

How early the implementation prevented or exposed defects across the complete adversarial case set.

How it is measured

Score = the arithmetic mean of detection-stage credits across 26 equally weighted hazards. The source scorer averages variants and sub-programs within each hazard first, so a hazard with more variants receives no extra case weight. Score breakdown · Methodology reference.

The committed run records preserve aggregate mechanical scores and identify the raw workspace artifact, but do not include the per-case verdicts, applicability counts or diagnostic text. The calculation can be described; a claim that a named failing case caused the gap cannot be verified from these retained records.

The source-snapshot detection ladder assigns 100 to compile-time detection or prevention by construction, 90 to static checking before execution, 75 to safe runtime detection, 55 to test failure, 40 to output verification, 20 to a crash, 5 to undefined behavior and 0 to a silent bug. Several safety metrics reuse this evidence with different formulas.

Quidra

Quidra 0.3.0

59.81 / 100

The recorded 59.81 is detection-stage credit averaged over the applicable cases in the prescribed 26-hazard set. More prevention or earlier diagnosis earns more credit, while crashes and plausible wrong results earn less. The per-case stages needed to identify this language's particular contributing failures were not retained in the repository summary.

Recorded evidence
Published mechanical score 59.81/100
Programs identified by the evidence record 37
Prescribed equally weighted hazard set 26

Evidence limits

Per-case raw observations are referenced by artifact path and hash, but are not embedded in the committed evidence. Case-level causal claims and exact applicable denominators are therefore unavailable here.

Best other

Java 26.0.1

65.00 / 100

The recorded 65.00 is detection-stage credit averaged over the applicable cases in the prescribed 26-hazard set. More prevention or earlier diagnosis earns more credit, while crashes and plausible wrong results earn less. The per-case stages needed to identify this language's particular contributing failures were not retained in the repository summary.

Recorded evidence
Published mechanical score 65.00/100
Programs identified by the evidence record 37
Prescribed equally weighted hazard set 26

Evidence limits

Per-case raw observations are referenced by artifact path and hash, but are not embedded in the committed evidence. Case-level causal claims and exact applicable denominators are therefore unavailable here.

23 / metric.debuggability

Effective evaluation weight ≈3.47%

Debuggability

A mechanical proxy for useful fault-report evidence in this published run.

How it is measured

The implemented diagnostic-evidence proxy gives 100 × (A1 + A2 + A3) ÷ 3 per report: A1 is 1 for a case-specific hazard match, 0.5 for a general hazard match, otherwise 0; A2 is 1 for a source position; A3 is 1 for a stable fault key. Prevention by construction receives 100. Scores are averaged within variants and then across cases. Score breakdown · Methodology reference.

The scorer explicitly states that the separate frozen 80-session diagnostic-agent protocol was not executed. These published numbers are the diagnostic-evidence proxy above, not a measured human debugging outcome.

The committed run records preserve aggregate mechanical scores and identify the raw workspace artifact, but do not include the per-case verdicts, applicability counts or diagnostic text. The calculation can be described; a claim that a named failing case caused the gap cannot be verified from these retained records.

The source-snapshot detection ladder assigns 100 to compile-time detection or prevention by construction, 90 to static checking before execution, 75 to safe runtime detection, 55 to test failure, 40 to output verification, 20 to a crash, 5 to undefined behavior and 0 to a silent bug. Several safety metrics reuse this evidence with different formulas.

Quidra

Quidra 0.3.0

66.67 / 100

The retained mechanical result is 66.67 for the diagnostic-evidence proxy. The source implementation rewards hazard identification, source locations and stable fault keys, but the compact record omits their individual A1/A2/A3 means and the diagnostic reports needed to attribute the exact difference.

Recorded evidence
Published mechanical score 66.67/100
Programs identified by the evidence record 37
Scored diagnostic components Hazard match · source position · stable fault key

Evidence limits

Per-case raw observations are referenced by artifact path and hash, but are not embedded in the committed evidence. Case-level causal claims and exact applicable denominators are therefore unavailable here.

Best other

Python 3.12.3

68.59 / 100

The retained mechanical result is 68.59 for the diagnostic-evidence proxy. The source implementation rewards hazard identification, source locations and stable fault keys, but the compact record omits their individual A1/A2/A3 means and the diagnostic reports needed to attribute the exact difference.

Recorded evidence
Published mechanical score 68.59/100
Programs identified by the evidence record 37
Scored diagnostic components Hazard match · source position · stable fault key

Evidence limits

Per-case raw observations are referenced by artifact path and hash, but are not embedded in the committed evidence. Case-level causal claims and exact applicable denominators are therefore unavailable here.

24 / metric.silent_bug_resistance

Effective evaluation weight ≈3.47%

Silent bug resistance

Resistance to apparently plausible wrong results under the adversarial decision procedure.

How it is measured

Score = 100 × (1 − silent-or-undefined row-weight ÷ applicable row-weight). Sub-programs share one row's weight. Undefined behavior is included because the relevant classifier outcomes are silent wrong results; uncontrolled termination is classified separately. Score breakdown · Methodology reference.

The committed run records preserve aggregate mechanical scores and identify the raw workspace artifact, but do not include the per-case verdicts, applicability counts or diagnostic text. The calculation can be described; a claim that a named failing case caused the gap cannot be verified from these retained records.

The source-snapshot detection ladder assigns 100 to compile-time detection or prevention by construction, 90 to static checking before execution, 75 to safe runtime detection, 55 to test failure, 40 to output verification, 20 to a crash, 5 to undefined behavior and 0 to a silent bug. Several safety metrics reuse this evidence with different formulas.

Quidra

Quidra 0.3.0

91.18 / 100

The recorded 91.18 corresponds to approximately 8.82% of applicable row-weight classified as a silent bug or undefined behavior, using the complement formula. This is a weighted aggregate, not a count of independently observed production bugs.

Recorded evidence
Published mechanical score 91.18/100
Programs identified by the evidence record 37
Silent / undefined row-weight implied by the score Approximately 8.82%

Evidence limits

Per-case raw observations are referenced by artifact path and hash, but are not embedded in the committed evidence. Case-level causal claims and exact applicable denominators are therefore unavailable here.

Best other

Swift 6.2.3

88.24 / 100

The recorded 88.24 corresponds to approximately 11.76% of applicable row-weight classified as a silent bug or undefined behavior, using the complement formula. This is a weighted aggregate, not a count of independently observed production bugs.

Recorded evidence
Published mechanical score 88.24/100
Programs identified by the evidence record 37
Silent / undefined row-weight implied by the score Approximately 11.76%

Evidence limits

Per-case raw observations are referenced by artifact path and hash, but are not embedded in the committed evidence. Case-level causal claims and exact applicable denominators are therefore unavailable here.

25 / metric.implementation_robustness

Effective evaluation weight ≈3.47%

Implementation robustness

Resistance to failures of the toolchain itself while handling the prescribed programs.

How it is measured

Score = 100 × (1 − flagged toolchain-failure row-weight ÷ applicable row-weight). The flags cover toolchain crashes, pre-execution toolchain crashes, successful builds producing no runnable artifact, and build timeouts. This is separate from a compiled program's runtime safety. Score breakdown · Methodology reference.

The committed run records preserve aggregate mechanical scores and identify the raw workspace artifact, but do not include the per-case verdicts, applicability counts or diagnostic text. The calculation can be described; a claim that a named failing case caused the gap cannot be verified from these retained records.

The source-snapshot detection ladder assigns 100 to compile-time detection or prevention by construction, 90 to static checking before execution, 75 to safe runtime detection, 55 to test failure, 40 to output verification, 20 to a crash, 5 to undefined behavior and 0 to a silent bug. Several safety metrics reuse this evidence with different formulas.

Quidra

Quidra 0.3.0

100.00 / 100

The published 100.00 corresponds to approximately 0.00% flagged toolchain-failure row-weight. A full score here reports that narrow aggregate; runtime crashes or incorrect outputs are assessed by other requirements.

Recorded evidence
Published mechanical score 100.00/100
Programs identified by the evidence record 37
Toolchain-failure row-weight implied by the score Approximately 0.00%

Evidence limits

Per-case raw observations are referenced by artifact path and hash, but are not embedded in the committed evidence. Case-level causal claims and exact applicable denominators are therefore unavailable here.

Best other · 7 tied languages

Python 3.12.3

100.00 / 100

The published 100.00 corresponds to approximately 0.00% flagged toolchain-failure row-weight. A full score here reports that narrow aggregate; runtime crashes or incorrect outputs are assessed by other requirements.

Recorded evidence
Published mechanical score 100.00/100
Programs identified by the evidence record 37
Toolchain-failure row-weight implied by the score Approximately 0.00%

Evidence limits

Per-case raw observations are referenced by artifact path and hash, but are not embedded in the committed evidence. Case-level causal claims and exact applicable denominators are therefore unavailable here.