Contents Menu Expand Light mode Dark mode Auto light/dark, in light mode Auto light/dark, in dark mode Skip to content
Scorable Python SDK documentation
Scorable Python SDK documentation

Contents:

  • Quickstart
  • SDK features using concrete examples
  • Asynchronous support
  • Authentication and setup
  • Release Notes
  • API Reference
    • scorable
      • scorable.client
      • scorable.datasets
      • scorable.execution_logs
      • scorable.generated
        • scorable.generated.openapi_aclient
          • scorable.generated.openapi_aclient.api
          • scorable.generated.openapi_aclient.models
            • scorable.generated.openapi_aclient.models.batch_execution_status
            • scorable.generated.openapi_aclient.models.data_set_create
            • scorable.generated.openapi_aclient.models.data_set_list
            • scorable.generated.openapi_aclient.models.data_set_type
            • scorable.generated.openapi_aclient.models.evaluator
            • scorable.generated.openapi_aclient.models.evaluator_calibration_output
            • scorable.generated.openapi_aclient.models.evaluator_calibration_result
            • scorable.generated.openapi_aclient.models.evaluator_demonstrations
            • scorable.generated.openapi_aclient.models.evaluator_execution_result
            • scorable.generated.openapi_aclient.models.evaluator_inputs_value
            • scorable.generated.openapi_aclient.models.evaluator_inputs_value_items
            • scorable.generated.openapi_aclient.models.evaluator_list_output
            • scorable.generated.openapi_aclient.models.evaluator_reference
            • scorable.generated.openapi_aclient.models.evaluator_result
            • scorable.generated.openapi_aclient.models.execution_log_details
            • scorable.generated.openapi_aclient.models.execution_log_details_evaluation_context
            • scorable.generated.openapi_aclient.models.execution_log_details_evaluator_latencies_inner
            • scorable.generated.openapi_aclient.models.execution_log_list
            • scorable.generated.openapi_aclient.models.execution_log_list_evaluation_context
            • scorable.generated.openapi_aclient.models.id
            • scorable.generated.openapi_aclient.models.input_variable
            • scorable.generated.openapi_aclient.models.judge
            • scorable.generated.openapi_aclient.models.judge_batch_execution_detail
            • scorable.generated.openapi_aclient.models.judge_batch_execution_item
            • scorable.generated.openapi_aclient.models.judge_batch_execution_item_input
            • scorable.generated.openapi_aclient.models.judge_batch_execution_item_status_enum
            • scorable.generated.openapi_aclient.models.judge_batch_execution_list_item
            • scorable.generated.openapi_aclient.models.judge_batch_execution_response
            • scorable.generated.openapi_aclient.models.judge_execution_response
            • scorable.generated.openapi_aclient.models.judge_files_inner
            • scorable.generated.openapi_aclient.models.judge_generator_response
            • scorable.generated.openapi_aclient.models.judge_generator_visibility_enum
            • scorable.generated.openapi_aclient.models.judge_list
            • scorable.generated.openapi_aclient.models.judge_rectifier_response
            • scorable.generated.openapi_aclient.models.judges_synthetic_data_retrieve200_response
            • scorable.generated.openapi_aclient.models.judges_synthetic_data_retrieve200_response_samples_inner
            • scorable.generated.openapi_aclient.models.message_log_turn
            • scorable.generated.openapi_aclient.models.model
            • scorable.generated.openapi_aclient.models.model_list
            • scorable.generated.openapi_aclient.models.model_list_visibility_enum
            • scorable.generated.openapi_aclient.models.model_test_response
            • scorable.generated.openapi_aclient.models.nested_evaluator
            • scorable.generated.openapi_aclient.models.nested_evaluator_objective
            • scorable.generated.openapi_aclient.models.nested_judge
            • scorable.generated.openapi_aclient.models.nested_objective_list
            • scorable.generated.openapi_aclient.models.nested_user_details
            • scorable.generated.openapi_aclient.models.objective
            • scorable.generated.openapi_aclient.models.objective_list
            • scorable.generated.openapi_aclient.models.paginated_data_set_list_list
            • scorable.generated.openapi_aclient.models.paginated_evaluator_list
            • scorable.generated.openapi_aclient.models.paginated_evaluator_list_output_list
            • scorable.generated.openapi_aclient.models.paginated_execution_log_list_list
            • scorable.generated.openapi_aclient.models.paginated_judge_batch_execution_list_item_list
            • scorable.generated.openapi_aclient.models.paginated_judge_list_list
            • scorable.generated.openapi_aclient.models.paginated_model_list_list
            • scorable.generated.openapi_aclient.models.paginated_objective_list
            • scorable.generated.openapi_aclient.models.paginated_objective_list_list
            • scorable.generated.openapi_aclient.models.provider
            • scorable.generated.openapi_aclient.models.reasoning_effort_enum
            • scorable.generated.openapi_aclient.models.role_enum
            • scorable.generated.openapi_aclient.models.skill_execution_validator_result
            • scorable.generated.openapi_aclient.models.skill_test_data_request_dataset_range
            • scorable.generated.openapi_aclient.models.status_enum
            • scorable.generated.openapi_aclient.models.target_enum
            • scorable.generated.openapi_aclient.models.validation_result_status
            • scorable.generated.openapi_aclient.models.visibility_ef8_enum
        • scorable.generated.openapi_client
          • scorable.generated.openapi_client.api
          • scorable.generated.openapi_client.models
            • scorable.generated.openapi_client.models.batch_execution_status
            • scorable.generated.openapi_client.models.data_set_create
            • scorable.generated.openapi_client.models.data_set_list
            • scorable.generated.openapi_client.models.data_set_type
            • scorable.generated.openapi_client.models.evaluator
            • scorable.generated.openapi_client.models.evaluator_calibration_output
            • scorable.generated.openapi_client.models.evaluator_calibration_result
            • scorable.generated.openapi_client.models.evaluator_demonstrations
            • scorable.generated.openapi_client.models.evaluator_execution_result
            • scorable.generated.openapi_client.models.evaluator_inputs_value
            • scorable.generated.openapi_client.models.evaluator_inputs_value_items
            • scorable.generated.openapi_client.models.evaluator_list_output
            • scorable.generated.openapi_client.models.evaluator_reference
            • scorable.generated.openapi_client.models.evaluator_result
            • scorable.generated.openapi_client.models.execution_log_details
            • scorable.generated.openapi_client.models.execution_log_details_evaluation_context
            • scorable.generated.openapi_client.models.execution_log_details_evaluator_latencies_inner
            • scorable.generated.openapi_client.models.execution_log_list
            • scorable.generated.openapi_client.models.execution_log_list_evaluation_context
            • scorable.generated.openapi_client.models.id
            • scorable.generated.openapi_client.models.input_variable
            • scorable.generated.openapi_client.models.judge
            • scorable.generated.openapi_client.models.judge_batch_execution_detail
            • scorable.generated.openapi_client.models.judge_batch_execution_item
            • scorable.generated.openapi_client.models.judge_batch_execution_item_input
            • scorable.generated.openapi_client.models.judge_batch_execution_item_status_enum
            • scorable.generated.openapi_client.models.judge_batch_execution_list_item
            • scorable.generated.openapi_client.models.judge_batch_execution_response
            • scorable.generated.openapi_client.models.judge_execution_response
            • scorable.generated.openapi_client.models.judge_files_inner
            • scorable.generated.openapi_client.models.judge_generator_response
            • scorable.generated.openapi_client.models.judge_generator_visibility_enum
            • scorable.generated.openapi_client.models.judge_list
            • scorable.generated.openapi_client.models.judge_rectifier_response
            • scorable.generated.openapi_client.models.judges_synthetic_data_retrieve200_response
            • scorable.generated.openapi_client.models.judges_synthetic_data_retrieve200_response_samples_inner
            • scorable.generated.openapi_client.models.message_log_turn
            • scorable.generated.openapi_client.models.model
            • scorable.generated.openapi_client.models.model_list
            • scorable.generated.openapi_client.models.model_list_visibility_enum
            • scorable.generated.openapi_client.models.model_test_response
            • scorable.generated.openapi_client.models.nested_evaluator
            • scorable.generated.openapi_client.models.nested_evaluator_objective
            • scorable.generated.openapi_client.models.nested_judge
            • scorable.generated.openapi_client.models.nested_objective_list
            • scorable.generated.openapi_client.models.nested_user_details
            • scorable.generated.openapi_client.models.objective
            • scorable.generated.openapi_client.models.objective_list
            • scorable.generated.openapi_client.models.paginated_data_set_list_list
            • scorable.generated.openapi_client.models.paginated_evaluator_list
            • scorable.generated.openapi_client.models.paginated_evaluator_list_output_list
            • scorable.generated.openapi_client.models.paginated_execution_log_list_list
            • scorable.generated.openapi_client.models.paginated_judge_batch_execution_list_item_list
            • scorable.generated.openapi_client.models.paginated_judge_list_list
            • scorable.generated.openapi_client.models.paginated_model_list_list
            • scorable.generated.openapi_client.models.paginated_objective_list
            • scorable.generated.openapi_client.models.paginated_objective_list_list
            • scorable.generated.openapi_client.models.provider
            • scorable.generated.openapi_client.models.reasoning_effort_enum
            • scorable.generated.openapi_client.models.role_enum
            • scorable.generated.openapi_client.models.skill_execution_validator_result
            • scorable.generated.openapi_client.models.skill_test_data_request_dataset_range
            • scorable.generated.openapi_client.models.status_enum
            • scorable.generated.openapi_client.models.target_enum
            • scorable.generated.openapi_client.models.validation_result_status
            • scorable.generated.openapi_client.models.visibility_ef8_enum
      • scorable.judges
      • scorable.models
      • scorable.multiturn
      • scorable.objectives
      • scorable.skills
Back to top
View this page

scorable.generated¶

Submodules¶

  • scorable.generated.openapi_aclient
  • scorable.generated.openapi_client
Next
scorable.generated.openapi_aclient
Previous
scorable.execution_logs
Copyright © 2025, Root Signals Ltd
Made with Sphinx and @pradyunsg's Furo
On this page
  • scorable.generated
    • Submodules