Contents Menu Expand Light mode Dark mode Auto light/dark, in light mode Auto light/dark, in dark mode Skip to content
Scorable Python SDK documentation
Scorable Python SDK documentation

Contents:

  • Quickstart
  • SDK features using concrete examples
  • Asynchronous support
  • Authentication and setup
  • Release Notes
  • API Reference
    • scorable
      • scorable.client
      • scorable.datasets
      • scorable.execution_logs
      • scorable.generated
        • scorable.generated.openapi_aclient
          • scorable.generated.openapi_aclient.api
          • scorable.generated.openapi_aclient.models
            • scorable.generated.openapi_aclient.models.data_set_create
            • scorable.generated.openapi_aclient.models.data_set_list
            • scorable.generated.openapi_aclient.models.data_set_type
            • scorable.generated.openapi_aclient.models.evaluation_agent
            • scorable.generated.openapi_aclient.models.evaluation_agent_evaluation_approach_enum
            • scorable.generated.openapi_aclient.models.evaluation_agent_execute_response
            • scorable.generated.openapi_aclient.models.evaluation_agent_generate_request_evaluation_approach_enum
            • scorable.generated.openapi_aclient.models.evaluation_batch_job_serializer
            • scorable.generated.openapi_aclient.models.evaluation_job_response
            • scorable.generated.openapi_aclient.models.evaluator
            • scorable.generated.openapi_aclient.models.evaluator_calibration_output
            • scorable.generated.openapi_aclient.models.evaluator_calibration_result
            • scorable.generated.openapi_aclient.models.evaluator_demonstrations
            • scorable.generated.openapi_aclient.models.evaluator_execution_result
            • scorable.generated.openapi_aclient.models.evaluator_inputs_value
            • scorable.generated.openapi_aclient.models.evaluator_inputs_value_items
            • scorable.generated.openapi_aclient.models.evaluator_list_output
            • scorable.generated.openapi_aclient.models.evaluator_reference
            • scorable.generated.openapi_aclient.models.evaluator_result
            • scorable.generated.openapi_aclient.models.execution_log_details
            • scorable.generated.openapi_aclient.models.execution_log_details_evaluation_context
            • scorable.generated.openapi_aclient.models.execution_log_details_evaluator_latencies_inner
            • scorable.generated.openapi_aclient.models.execution_log_list
            • scorable.generated.openapi_aclient.models.execution_log_list_evaluation_context
            • scorable.generated.openapi_aclient.models.id
            • scorable.generated.openapi_aclient.models.input_variable
            • scorable.generated.openapi_aclient.models.job_status
            • scorable.generated.openapi_aclient.models.judge
            • scorable.generated.openapi_aclient.models.judge_batch_execution_detail
            • scorable.generated.openapi_aclient.models.judge_batch_execution_item
            • scorable.generated.openapi_aclient.models.judge_batch_execution_item_input
            • scorable.generated.openapi_aclient.models.judge_batch_execution_item_status_enum
            • scorable.generated.openapi_aclient.models.judge_batch_execution_list_item
            • scorable.generated.openapi_aclient.models.judge_batch_execution_response
            • scorable.generated.openapi_aclient.models.judge_execution_response
            • scorable.generated.openapi_aclient.models.judge_files_inner
            • scorable.generated.openapi_aclient.models.judge_generator_response
            • scorable.generated.openapi_aclient.models.judge_generator_visibility_enum
            • scorable.generated.openapi_aclient.models.judge_list
            • scorable.generated.openapi_aclient.models.judge_rectifier_response
            • scorable.generated.openapi_aclient.models.kind_enum
            • scorable.generated.openapi_aclient.models.model
            • scorable.generated.openapi_aclient.models.model_enum
            • scorable.generated.openapi_aclient.models.model_list
            • scorable.generated.openapi_aclient.models.model_list_visibility_enum
            • scorable.generated.openapi_aclient.models.model_params
            • scorable.generated.openapi_aclient.models.model_test_response
            • scorable.generated.openapi_aclient.models.nested_evaluator
            • scorable.generated.openapi_aclient.models.nested_evaluator_objective
            • scorable.generated.openapi_aclient.models.nested_judge
            • scorable.generated.openapi_aclient.models.nested_objective
            • scorable.generated.openapi_aclient.models.nested_objective_evaluator
            • scorable.generated.openapi_aclient.models.nested_objective_list
            • scorable.generated.openapi_aclient.models.nested_user_details
            • scorable.generated.openapi_aclient.models.nested_vector_objective
            • scorable.generated.openapi_aclient.models.null_enum
            • scorable.generated.openapi_aclient.models.objective
            • scorable.generated.openapi_aclient.models.objective_list
            • scorable.generated.openapi_aclient.models.objective_validator
            • scorable.generated.openapi_aclient.models.paginated_data_set_list_list
            • scorable.generated.openapi_aclient.models.paginated_evaluation_agent_list
            • scorable.generated.openapi_aclient.models.paginated_evaluation_batch_job_serializer_list
            • scorable.generated.openapi_aclient.models.paginated_evaluator_list
            • scorable.generated.openapi_aclient.models.paginated_evaluator_list_output_list
            • scorable.generated.openapi_aclient.models.paginated_execution_log_list_list
            • scorable.generated.openapi_aclient.models.paginated_judge_batch_execution_list_item_list
            • scorable.generated.openapi_aclient.models.paginated_judge_list_list
            • scorable.generated.openapi_aclient.models.paginated_model_list_list
            • scorable.generated.openapi_aclient.models.paginated_objective_list
            • scorable.generated.openapi_aclient.models.paginated_objective_list_list
            • scorable.generated.openapi_aclient.models.provider
            • scorable.generated.openapi_aclient.models.reasoning_effort_enum
            • scorable.generated.openapi_aclient.models.reference_variable
            • scorable.generated.openapi_aclient.models.result_preference_signifier_evaluation_approach_enum
            • scorable.generated.openapi_aclient.models.skill_execution_validator_result
            • scorable.generated.openapi_aclient.models.skill_test_data_request_dataset_range
            • scorable.generated.openapi_aclient.models.skill_type_enum
            • scorable.generated.openapi_aclient.models.status776_enum
            • scorable.generated.openapi_aclient.models.status_change
            • scorable.generated.openapi_aclient.models.status_change_status_enum
            • scorable.generated.openapi_aclient.models.status_enum
            • scorable.generated.openapi_aclient.models.validation_result_status
        • scorable.generated.openapi_client
          • scorable.generated.openapi_client.api
          • scorable.generated.openapi_client.models
            • scorable.generated.openapi_client.models.data_set_create
            • scorable.generated.openapi_client.models.data_set_list
            • scorable.generated.openapi_client.models.data_set_type
            • scorable.generated.openapi_client.models.evaluation_agent
            • scorable.generated.openapi_client.models.evaluation_agent_evaluation_approach_enum
            • scorable.generated.openapi_client.models.evaluation_agent_execute_response
            • scorable.generated.openapi_client.models.evaluation_agent_generate_request_evaluation_approach_enum
            • scorable.generated.openapi_client.models.evaluation_batch_job_serializer
            • scorable.generated.openapi_client.models.evaluation_job_response
            • scorable.generated.openapi_client.models.evaluator
            • scorable.generated.openapi_client.models.evaluator_calibration_output
            • scorable.generated.openapi_client.models.evaluator_calibration_result
            • scorable.generated.openapi_client.models.evaluator_demonstrations
            • scorable.generated.openapi_client.models.evaluator_execution_result
            • scorable.generated.openapi_client.models.evaluator_inputs_value
            • scorable.generated.openapi_client.models.evaluator_inputs_value_items
            • scorable.generated.openapi_client.models.evaluator_list_output
            • scorable.generated.openapi_client.models.evaluator_reference
            • scorable.generated.openapi_client.models.evaluator_result
            • scorable.generated.openapi_client.models.execution_log_details
            • scorable.generated.openapi_client.models.execution_log_details_evaluation_context
            • scorable.generated.openapi_client.models.execution_log_details_evaluator_latencies_inner
            • scorable.generated.openapi_client.models.execution_log_list
            • scorable.generated.openapi_client.models.execution_log_list_evaluation_context
            • scorable.generated.openapi_client.models.id
            • scorable.generated.openapi_client.models.input_variable
            • scorable.generated.openapi_client.models.job_status
            • scorable.generated.openapi_client.models.judge
            • scorable.generated.openapi_client.models.judge_batch_execution_detail
            • scorable.generated.openapi_client.models.judge_batch_execution_item
            • scorable.generated.openapi_client.models.judge_batch_execution_item_input
            • scorable.generated.openapi_client.models.judge_batch_execution_item_status_enum
            • scorable.generated.openapi_client.models.judge_batch_execution_list_item
            • scorable.generated.openapi_client.models.judge_batch_execution_response
            • scorable.generated.openapi_client.models.judge_execution_response
            • scorable.generated.openapi_client.models.judge_files_inner
            • scorable.generated.openapi_client.models.judge_generator_response
            • scorable.generated.openapi_client.models.judge_generator_visibility_enum
            • scorable.generated.openapi_client.models.judge_list
            • scorable.generated.openapi_client.models.judge_rectifier_response
            • scorable.generated.openapi_client.models.kind_enum
            • scorable.generated.openapi_client.models.model
            • scorable.generated.openapi_client.models.model_enum
            • scorable.generated.openapi_client.models.model_list
            • scorable.generated.openapi_client.models.model_list_visibility_enum
            • scorable.generated.openapi_client.models.model_params
            • scorable.generated.openapi_client.models.model_test_response
            • scorable.generated.openapi_client.models.nested_evaluator
            • scorable.generated.openapi_client.models.nested_evaluator_objective
            • scorable.generated.openapi_client.models.nested_judge
            • scorable.generated.openapi_client.models.nested_objective
            • scorable.generated.openapi_client.models.nested_objective_evaluator
            • scorable.generated.openapi_client.models.nested_objective_list
            • scorable.generated.openapi_client.models.nested_user_details
            • scorable.generated.openapi_client.models.nested_vector_objective
            • scorable.generated.openapi_client.models.null_enum
            • scorable.generated.openapi_client.models.objective
            • scorable.generated.openapi_client.models.objective_list
            • scorable.generated.openapi_client.models.objective_validator
            • scorable.generated.openapi_client.models.paginated_data_set_list_list
            • scorable.generated.openapi_client.models.paginated_evaluation_agent_list
            • scorable.generated.openapi_client.models.paginated_evaluation_batch_job_serializer_list
            • scorable.generated.openapi_client.models.paginated_evaluator_list
            • scorable.generated.openapi_client.models.paginated_evaluator_list_output_list
            • scorable.generated.openapi_client.models.paginated_execution_log_list_list
            • scorable.generated.openapi_client.models.paginated_judge_batch_execution_list_item_list
            • scorable.generated.openapi_client.models.paginated_judge_list_list
            • scorable.generated.openapi_client.models.paginated_model_list_list
            • scorable.generated.openapi_client.models.paginated_objective_list
            • scorable.generated.openapi_client.models.paginated_objective_list_list
            • scorable.generated.openapi_client.models.provider
            • scorable.generated.openapi_client.models.reasoning_effort_enum
            • scorable.generated.openapi_client.models.reference_variable
            • scorable.generated.openapi_client.models.result_preference_signifier_evaluation_approach_enum
            • scorable.generated.openapi_client.models.skill_execution_validator_result
            • scorable.generated.openapi_client.models.skill_test_data_request_dataset_range
            • scorable.generated.openapi_client.models.skill_type_enum
            • scorable.generated.openapi_client.models.status776_enum
            • scorable.generated.openapi_client.models.status_change
            • scorable.generated.openapi_client.models.status_change_status_enum
            • scorable.generated.openapi_client.models.status_enum
            • scorable.generated.openapi_client.models.validation_result_status
      • scorable.judges
      • scorable.models
      • scorable.objectives
      • scorable.skills
Back to top
View this page

scorable.generated.openapi_client¶

Submodules¶

  • scorable.generated.openapi_client.api
  • scorable.generated.openapi_client.models
Next
scorable.generated.openapi_client.api
Previous
scorable.generated.openapi_aclient.models.validation_result_status
Copyright © 2025, Root Signals Ltd
Made with Sphinx and @pradyunsg's Furo
On this page
  • scorable.generated.openapi_client
    • Submodules