Demo hydra nodes crashing with $.costModels[175]: parsing Int64 failed errors

[Anviking]

Context & versions

Rev 2cd1974, hydra-node 0.19.0, cardano-node 9.1.1
Issue was also seen by @paweljakubas, so it's not only on my machine

Steps to reproduce

Following the "getting started" instructions:

cd hydra/demo
./prepare-devnet.sh
docker compose up -d cardano-node
./seed-devnet.sh
docker compose up -d hydra-node-{1,2,3}

Actual behavior

The hydra nodes are stuck crashing and rebooting with logs like

2024-10-03 11:58:25 user error (Error in $.costModels[175]: parsing Int64 failed, value is either floating or will cause over or underflow 9.223372036854776e18)

Expected behavior

Hydra nodes launch when following the "getting started" instructions

Workaround

In devnet/protocol-parameters.json the final 10 values of costModels.PlutusV2 are 9223372036854776000 :

      38887044,
      32947,
      10,
      9223372036854776000,
      9223372036854776000,
      9223372036854776000,
      9223372036854776000,
      9223372036854776000,
      9223372036854776000,
      9223372036854776000,
      9223372036854776000,
      9223372036854776000,
      9223372036854776000

If we change these to instead be 0 the hydra nodes launch properly and we can proceed with the demo.

It appears it's also possible to drop these 10 values completely.

Further investigation

We can also confirm that these values are also present in the response of the cardano-cli query:

docker compose exec cardano-node cardano-cli query protocol-parameters --testnet-magic 42 | jq .costModels.PlutusV2`

If we check devnet/genesis-alonzo.json we see the final values of costModels.PlutusV2 are:

            38887044,
            32947,
            10

i.e. the 10 9223372036854776000 fields/values are not there.

So it seems cardano-cli or some upstream component are adding them.

[ch1bo]

@Anviking what jq version do you use?

We had an issue with jq < 1.7 and integer parsing of protocol parameters recently and our seed-devnet.sh script uses jq to set L2 costs to zero. See #1338 (comment) and #1601

[ch1bo]

@noonio Any ideas how we could make the getting start experience not fall into this pithole (if it is indeed the jq version problem). Nix is not an option :)

[noonio]

I think the best we can do is just add a note/warning and suggest to people they can verify with:

[[ $(jq -n '9223372036854775807') == "9223372036854775807" ]] \
  && echo "jq ok" \
  || echo "bad: please upgrade jq"

[Anviking]

I was using jq-1.6. However, the 9223372036854775807 values are present in the output from cardano-cli even without jq:

cardano-cli query protocol-parameters output

docker compose exec cardano-node cardano-cli query protocol-parameters --testnet-magic 42
{
    "collateralPercentage": 150,
    "committeeMaxTermLength": 365,
    "committeeMinSize": 0,
    "costModels": {
        "PlutusV1": [
            205665,
            812,
            1,
            1,
            1000,
            571,
            0,
            1,
            1000,
            24177,
            4,
            1,
            1000,
            32,
            117366,
            10475,
            4,
            23000,
            100,
            23000,
            100,
            23000,
            100,
            23000,
            100,
            23000,
            100,
            23000,
            100,
            100,
            100,
            23000,
            100,
            19537,
            32,
            175354,
            32,
            46417,
            4,
            221973,
            511,
            0,
            1,
            89141,
            32,
            497525,
            14068,
            4,
            2,
            196500,
            453240,
            220,
            0,
            1,
            1,
            1000,
            28662,
            4,
            2,
            245000,
            216773,
            62,
            1,
            1060367,
            12586,
            1,
            208512,
            421,
            1,
            187000,
            1000,
            52998,
            1,
            80436,
            32,
            43249,
            32,
            1000,
            32,
            80556,
            1,
            57667,
            4,
            1000,
            10,
            197145,
            156,
            1,
            197145,
            156,
            1,
            204924,
            473,
            1,
            208896,
            511,
            1,
            52467,
            32,
            64832,
            32,
            65493,
            32,
            22558,
            32,
            16563,
            32,
            76511,
            32,
            196500,
            453240,
            220,
            0,
            1,
            1,
            69522,
            11687,
            0,
            1,
            60091,
            32,
            196500,
            453240,
            220,
            0,
            1,
            1,
            196500,
            453240,
            220,
            0,
            1,
            1,
            806990,
            30482,
            4,
            1927926,
            82523,
            4,
            265318,
            0,
            4,
            0,
            85931,
            32,
            205665,
            812,
            1,
            1,
            41182,
            32,
            212342,
            32,
            31220,
            32,
            32696,
            32,
            43357,
            32,
            32247,
            32,
            38314,
            32,
            57996947,
            18975,
            10
        ],
        "PlutusV2": [
            205665,
            812,
            1,
            1,
            1000,
            571,
            0,
            1,
            1000,
            24177,
            4,
            1,
            1000,
            32,
            117366,
            10475,
            4,
            23000,
            100,
            23000,
            100,
            23000,
            100,
            23000,
            100,
            23000,
            100,
            23000,
            100,
            100,
            100,
            23000,
            100,
            19537,
            32,
            175354,
            32,
            46417,
            4,
            221973,
            511,
            0,
            1,
            89141,
            32,
            497525,
            14068,
            4,
            2,
            196500,
            453240,
            220,
            0,
            1,
            1,
            1000,
            28662,
            4,
            2,
            245000,
            216773,
            62,
            1,
            1060367,
            12586,
            1,
            208512,
            421,
            1,
            187000,
            1000,
            52998,
            1,
            80436,
            32,
            43249,
            32,
            1000,
            32,
            80556,
            1,
            57667,
            4,
            1000,
            10,
            197145,
            156,
            1,
            197145,
            156,
            1,
            204924,
            473,
            1,
            208896,
            511,
            1,
            52467,
            32,
            64832,
            32,
            65493,
            32,
            22558,
            32,
            16563,
            32,
            76511,
            32,
            196500,
            453240,
            220,
            0,
            1,
            1,
            69522,
            11687,
            0,
            1,
            60091,
            32,
            196500,
            453240,
            220,
            0,
            1,
            1,
            196500,
            453240,
            220,
            0,
            1,
            1,
            1159724,
            392670,
            0,
            2,
            806990,
            30482,
            4,
            1927926,
            82523,
            4,
            265318,
            0,
            4,
            0,
            85931,
            32,
            205665,
            812,
            1,
            1,
            41182,
            32,
            212342,
            32,
            31220,
            32,
            32696,
            32,
            43357,
            32,
            32247,
            32,
            38314,
            32,
            35892428,
            10,
            57996947,
            18975,
            10,
            38887044,
            32947,
            10,
            9223372036854775807,
            9223372036854775807,
            9223372036854775807,
            9223372036854775807,
            9223372036854775807,
            9223372036854775807,
            9223372036854775807,
            9223372036854775807,
            9223372036854775807,
            9223372036854775807
        ],
        "PlutusV3": [
            100788,
            420,
            1,
            1,
            1000,
            173,
            0,
            1,
            1000,
            59957,
            4,
            1,
            11183,
            32,
            201305,
            8356,
            4,
            16000,
            100,
            16000,
            100,
            16000,
            100,
            16000,
            100,
            16000,
            100,
            16000,
            100,
            100,
            100,
            16000,
            100,
            94375,
            32,
            132994,
            32,
            61462,
            4,
            72010,
            178,
            0,
            1,
            22151,
            32,
            91189,
            769,
            4,
            2,
            85848,
            123203,
            7305,
            -900,
            1716,
            549,
            57,
            85848,
            0,
            1,
            1,
            1000,
            42921,
            4,
            2,
            24548,
            29498,
            38,
            1,
            898148,
            27279,
            1,
            51775,
            558,
            1,
            39184,
            1000,
            60594,
            1,
            141895,
            32,
            83150,
            32,
            15299,
            32,
            76049,
            1,
            13169,
            4,
            22100,
            10,
            28999,
            74,
            1,
            28999,
            74,
            1,
            43285,
            552,
            1,
            44749,
            541,
            1,
            33852,
            32,
            68246,
            32,
            72362,
            32,
            7243,
            32,
            7391,
            32,
            11546,
            32,
            85848,
            123203,
            7305,
            -900,
            1716,
            549,
            57,
            85848,
            0,
            1,
            90434,
            519,
            0,
            1,
            74433,
            32,
            85848,
            123203,
            7305,
            -900,
            1716,
            549,
            57,
            85848,
            0,
            1,
            1,
            85848,
            123203,
            7305,
            -900,
            1716,
            549,
            57,
            85848,
            0,
            1,
            955506,
            213312,
            0,
            2,
            270652,
            22588,
            4,
            1457325,
            64566,
            4,
            20467,
            1,
            4,
            0,
            141992,
            32,
            100788,
            420,
            1,
            1,
            81663,
            32,
            59498,
            32,
            20142,
            32,
            24588,
            32,
            20744,
            32,
            25933,
            32,
            24623,
            32,
            43053543,
            10,
            53384111,
            14333,
            10,
            43574283,
            26308,
            10,
            16000,
            100,
            16000,
            100,
            962335,
            18,
            2780678,
            6,
            442008,
            1,
            52538055,
            3756,
            18,
            267929,
            18,
            76433006,
            8868,
            18,
            52948122,
            18,
            1995836,
            36,
            3227919,
            12,
            901022,
            1,
            166917843,
            4307,
            36,
            284546,
            36,
            158221314,
            26549,
            36,
            74698472,
            36,
            333849714,
            1,
            254006273,
            72,
            2174038,
            72,
            2261318,
            64571,
            4,
            207616,
            8310,
            4,
            1293828,
            28716,
            63,
            0,
            1,
            1006041,
            43623,
            251,
            0,
            1
        ]
    },
    "dRepActivity": 20,
    "dRepDeposit": 500000000,
    "dRepVotingThresholds": {
        "committeeNoConfidence": 0.6,
        "committeeNormal": 0.67,
        "hardForkInitiation": 0.6,
        "motionNoConfidence": 0.67,
        "ppEconomicGroup": 0.67,
        "ppGovGroup": 0.75,
        "ppNetworkGroup": 0.67,
        "ppTechnicalGroup": 0.67,
        "treasuryWithdrawal": 0.67,
        "updateToConstitution": 0.75
    },
    "executionUnitPrices": {
        "priceMemory": 5.77e-2,
        "priceSteps": 7.21e-5
    },
    "govActionDeposit": 100000000000,
    "govActionLifetime": 30,
    "maxBlockBodySize": 65536,
    "maxBlockExecutionUnits": {
        "memory": 62000000,
        "steps": 40000000000
    },
    "maxBlockHeaderSize": 1100,
    "maxCollateralInputs": 3,
    "maxTxExecutionUnits": {
        "memory": 14000000,
        "steps": 10000000000
    },
    "maxTxSize": 16384,
    "maxValueSize": 5000,
    "minFeeRefScriptCostPerByte": 15,
    "minPoolCost": 0,
    "monetaryExpansion": 0.1,
    "poolPledgeInfluence": 0,
    "poolRetireMaxEpoch": 18,
    "poolVotingThresholds": {
        "committeeNoConfidence": 0.51,
        "committeeNormal": 0.51,
        "hardForkInitiation": 0.51,
        "motionNoConfidence": 0.51,
        "ppSecurityGroup": 0.51
    },
    "protocolVersion": {
        "major": 7,
        "minor": 0
    },
    "stakeAddressDeposit": 0,
    "stakePoolDeposit": 0,
    "stakePoolTargetNum": 100,
    "treasuryCut": 0.1,
    "txFeeFixed": 155381,
    "txFeePerByte": 44,
    "utxoCostPerByte": 4310
}

[noonio]

@Anviking yes - those values are the "correct" ones ( in fact, they represent the maximum cost possible ); note that the jq roundtrip we check asserts that they stay that way; in fact, with an older jq, they get changed to the ones you report in your original message :)

[Anviking]

Ah! I didn't even spot the difference! I reran the demo steps from the beginning (after upgrading jq) and it works now. Thanks!