Welcome to the IneqMath Dev Set Evaluation Platform!

Please see the official leaderboard page for more submission details.

🌐 Project | 🏆 Leaderboard | arxiv | 🤗 HF Paper | Code | 🤗 Dataset | 🔮 Visualization

Submit New Model Evaluation Results for Dev Set

Please upload the JSON file with model evaluation results for the dev set and fill in the following information. If you have any questions, please contact us at jiayi_sheng@berkeley.edu or lupantech@gmail.com.
⚠️
Dev Set Evaluation Only
This website is for dev set evaluation only. For official leaderboard and test set evaluation, please visit https://huggingface.co/spaces/AI4Math/IneqMath-Leaderboard.
⚠️
OpenAI API Key Highly Recommended for Evaluation
• A valid OpenAI API key (Tier 3+ with $30+ budget) is highly recommended for more stable LLM judge evaluation. We do not save or store your API key - it's only used during evaluation.
• You can revoke or deactivate your key 15 minutes after evaluation completion. The evaluation process typically costs around $25 depending on your submission size.
• If no API key is provided, your submission will be processed with our default API key.
Model Type *

Select the type of your model
Model Source *

Select whether the model is proprietary or open-source
Reasoning effort

Optional: Select the reasoning effort level

Required JSON Structure:

Your JSON file must include at least these 5 fields for each problem:

[
    {
        "data_id": [integer or string] The ID of the test data,
        "problem": [string] The question text,
        "type": [string] The type of question: 'relation' or 'bound',
        "prompt": [string] The prompt used for the problem,
        "response": [string] The response of the model
    },
    ...
]

You can click the download button below to get an example file. The system will process your submission and calculate accuracy metrics automatically.