Skip to content
memoctetDownload
Language English
Menu

Measurements

Last measured · Page updated

Compare your answer with ours

Seed
qwen3-06b · 464 bytes, names Qwen3-0.6B-Q8_0.gguf · 639,446,688 bytes
Question
Quelle est la capitale de la France ? Type it exactly, in French. It means: “What is the capital of France?”
When
Ask it first, right after germer, in a new --maison folder.
Settings
temperature 0 · top-k 1 · sampling seed 1 · up to 256 tokens · no prompt cache
Expected
12 tokens · SHA-256 of the token IDs 72ede708a51254a736c03ecc883d0656d0f2e382e2aa288f33f5104663e402cf Click once to select the whole value.
Text
La capitale de la France est **Paris**.
Measured
31 runs · 12 machines (11 Linux, 1 Windows 11 VM) · AMD 6, Intel 5, not recorded 1 · all rented · to · 0 differences · as of
  • Linux, processor AMD EPYC 7713, rented, : same tokens
  • Linux, processor not recorded, rented, : same tokens
  • Linux, processor AMD EPYC 7K62, rented, : same tokens
  • Linux, processor Intel Xeon E5-2673 v4, rented, : same tokens
  • Linux, processor AMD EPYC 7452, rented, : same tokens
  • Linux, processor AMD Ryzen 5 5600X, rented, : same tokens
  • Linux, processor Intel Xeon Gold 6342, rented, : same tokens
  • Linux, processor Intel Xeon E5-2690 v4, rented, : same tokens
  • Windows 11, processor Intel Xeon E5-2673 v4, rented, to : same tokens
  • Linux, processor AMD EPYC 7551P, rented, : same tokens
  • Linux, processor Intel Xeon E5-2680 v4, rented, : same tokens
  • Linux, processor AMD Ryzen 7 9800X3D, rented, : same tokens
Outside ZMLabs
Checked outside ZMLabs: 0 (as of )

This fingerprint identifies the answer, not the model: qwen3-4b, qwen3-8b and qwen3-8b-source give the same tokens to this question. The byte check on download identifies the model file.

Run it in three steps Tell us your result

Measured

  • Claim
    Same 12 tokens for the test question of qwen3-06b
    Scope
    31 runs · 12 machines (11 Linux, 1 Windows 11 VM) · AMD and Intel · all rented · 0 differences · as of
    Date
    to
  • Claim
    26 of 35 seeds give the same tokens on Linux and Windows
    Scope
    2 differ by OS · 5 not compared · 2 refused · 1 to 3 test questions · mostly 2 machines per seed, both Intel, player 1.2
    Date
    to
  • Claim
    20 of 35 give the same tokens on AMD and Intel
    Scope
    13 not measured · 2 refused · same OS only · 2 to 10 machines
    Date
    to
  • Claim
    273 expected answers on 28 seeds
    Scope
    Linux and Windows differ on 4 test questions for 2 seeds (2 first differences, on 1 Linux and 1 Windows machine; later questions of the same conversation carry them)
    Date
    to
  • Claim
    33 of 35 seeds passed start-up
    Scope
    2 refused at start-up, cause published · tested when each seed was made (Linux, glibc 2.35) · the 6 largest were not run in our September measurements
    Date
    to
    Data
    catalogue.json; date from our run log (SHA-256 published)
  • Claim
    65 refusals in our own tests, each with its cause
    Scope
    forged or edited conversation files · model files other than the one the seed names · missing or wrong dates · a dead proxy standing in for Hugging Face · a start-up timer forced to 1 s · a model file outside the folder · a --matiere path that does not exist · a llama31-8b conversation resumed later on another server (its chat template includes the date)
    Date
    to
  • Claim
    Speed ranges for 28 seeds
    Scope
    3 rented AMD EPYC servers shared with other work · 8 threads · short answers in a new conversation · player 1.2, same engines · partial runs not counted: gemma4-12b
    Date
    Data
    vitesse_mesuree.json (derived copy)
  • Claim
    Peak memory for 2 seeds
    Scope
    qwen3-06b 909 MiB, llama32-1b 1.33 GiB · 1 rented Linux server · largest process only, not the player and its engine together · one run · player 1.3.1
    Date
    Data
    parcours.json
  • Claim
    Archives 1.3.1
    Scope
    2 files, SHA-256 published, not signed
    Date
  • Claim
    This site's commands, run as shown
    Scope
    Ubuntu 22.04.5 LTS, new container on a rented server · Windows 11 VM used before, its earlier files moved aside · rented
    Date
    Data
    parcours.json

Not measured

  • Checked by people outside ZMLabs: 0 (as of )
  • macOS, ARM, phones: no build
  • GPU: the player uses the CPU
  • Windows 10: not tested
  • Speed on your computer
  • Peak memory for 33 seeds
  • Dense models of 7 to 8 billion parameters on a laptop: never timed
  • Answer quality: not judged. The player only checks that an answer is not degenerate. Task scores in the catalogue data are for other quantizations, not these files.
  • Linux vs Windows for 5 seeds; AMD vs Intel for 13
  • The 2 refused seeds, run again with player 1.3.1 (refused in August; same engine build)
  • SmartScreen after a browser download (as of )
  • A CPU without AVX2 (checked by the player, never run)
  • What happens with --quand-meme (it skips the RAM and processor checks)

Machines

IDHostSystemCPUMakerRented or ownedPlayerDate
M1H1LinuxAMD EPYC 7713AMDrentedunreleased working build
M2H2LinuxAMD EPYC 9654AMDrentedunreleased working build
M3H3Linuxnot recordednot recordedrentedunreleased working build
M4H4LinuxAMD EPYC 7K62AMDrentedunreleased working build
M5H5LinuxIntel Xeon E5-2673 v4Intelrentedunreleased working build
M6H6LinuxAMD EPYC 7452AMDrented1.1
M7H7LinuxAMD Ryzen 5 5600XAMDrented1.1
M8H8LinuxIntel Xeon Gold 6342Intelrented1.1
M9H9Windows 11 HomeAMD Ryzen 7 8845HSAMDowned1.1
M10H10LinuxIntel Xeon E5-2690 v4Intelrented1.1
M11H11Windows 11 ProIntel Xeon E5-2673 v4Intelrented1.1
M12H12LinuxAMD EPYC 7K62AMDrented1.2
M13H13LinuxAMD EPYC 7551PAMDrented1.2
M14H11Windows 11 ProIntel Xeon E5-2673 v4Intelrented1.2
M15H14LinuxIntel Core i7-6700Intelrented1.2
M16H11Windows 11 ProIntel Xeon E5-2673 v4Intelrented1.2
M17H15Windows 11 ProIntel Xeon E5-2673 v4Intelrented1.2
M18H16Debian GNU/Linux 12 (bookworm)Intel Xeon E5-2680 v4Intelrented1.3
M19H11Windows 11 ProIntel Xeon E5-2673 v4Intelrented1.3
M20H17Debian GNU/Linux 13 (trixie)AMD Ryzen 7 9800X3DAMDrented1.3.1
M21H11Windows 11 ProIntel Xeon E5-2673 v4Intelrented1.3.1
M22H18Debian 12 (bookworm)Intel Xeon E5-2680 v4Intelrented1.2
M23H19Fedora Linux 42 (Container Image)AMD EPYC 7551AMDrented1.2
M24H20Windows 11 ProIntel Xeon Platinum 8171MIntelrented1.2
M25H21openSUSE Leap 15.6AMD EPYC 7402PAMDrented1.3
M26H22Windows 11 ProIntel Xeon E5-2673 v4Intelrented1.3

Engines and seeds are identical across players 1.1 to 1.3.1.

identites_os.json is the exact table inside player 1.3.1; its machine labels are internal names.

Each rented Linux server counts as one machine: from one rental to the next, we did not check whether the physical host was the same.

First differences between Linux and Windows (2)

  • ernie-45-21b-a3b · Quelle est la capitale de la France ? (“What is the capital of France?”)

    Linux: 67a5d4a7…f993f · Windows 11: 7535bf8d…3fe1f

    Later questions that carry it: What is the capital of Italy?, Continue la suite : 2, 4, 8, 16, (“Continue the sequence: 2, 4, 8, 16,”)

  • qwen36-35b-a3b · Continue la suite : 2, 4, 8, 16, (“Continue the sequence: 2, 4, 8, 16,”)

    Linux: f40f42e8…8e4a5 · Windows 11: 527d5aab…1e907

Data from our run logs: 4 JSON files, 2 test vectors
FileSizeSHA-256
catalogue.json237.7 KiB3dfa0d66…7dba6
identites_os.json24.6 KiB30528bfd…38b97
quittances_attendues.json607.1 KiB5ecaeeb7…d0153
vitesse_mesuree.json67.4 KiB71fe5cc5…c4bed
journal_A.json (negative test vector)1.1 KiB86192dbb…e419c
journal_forge.json (negative test vector)1.3 KiBce0cff42…820a7

Published data: summaries derived from our run logs. Raw run logs: not public.