Auth and smoke test
- Login to obtain a token
- List datasets to test out access
- API
- Python
Create a Dataset
- First, create an empty dataset
- Then, add CSV data to the created dataset
- Lastly, poll for progress until
COMPLETED
- API
- Python
datasetUploadInfo > uploadUrl URL and craft a PUT request with the extraHeaders with your CSV data:COMPLETED (or FAILED):- The
datasetKeyuniquely identifies the dataset - The
datasetNameis a descriptive name to distinguish it from others or versions of the same underlying data - The
numberOfBucketsis key hyperparameter that determines how data is shaped for training
Train a Model
Once the dataset is created and inCOMPLETED state, training can be executed with the following commands and endpoints.
- Target
0.99performance viaperformanceThreshold(see Glossary for metric definitions) - Pass
19as the scaling factor
- API
- Python
trainingProgressUrl directly or appending /progress to it for a more detailed view:trainingJobs) and one overall status for whole training process launched.
- The job/algorithm with the highest achieved performance will be the winner (first getting to
COMPLETEDstatus) - When a job doesn’t reach the target performance in the timeout time (
1hcurrently), it’s marked withTIMEOUTstatus - When a job doesn’t progress at least
0.02for a given period (5 minutes) it’s stopped and marked asNOT_COMPLETED(stalled) - When a job has an irrecoverable failure is marked as
FAILEDand stopped - The overall process stops only when all jobs are out of
PROCESSING. As long as 1 job completes successfully, the overall process isCOMPLETED - A champion model is created from the successful training, marking it as the best performing model so far for the dataset. If training is repeated with different hyperparameters and better performance is achieved, the champion model is overridden with the best one
BSEV02 with latest performance 0.90000. Retrieve the training detail to get the model key:
- API
- Python
modelKey=8a86bd31-ff0c-47c1-bdb8-d08331904508 can then be used to run predictions on unseen data.
Run Predictions
After getting the desired champion model trained, it’s time to run predictions with it. Before running a prediction check the model details:- API
- Python
- API
- Python
- API
- Python
COMPLETED, the result CSV can be downloaded:
- API
- Python
Hyperparameter Tuning
Hyperparameter tuning is done by combining the above endpoints in order to incrementally obtain better performance by changing the hyper-parameters:- Create new versions of dataset with increased/decreased number of buckets
- Re-train using the training endpoints and progress monitoring observation with more or less scaling factor until the result is
COMPLETEDsuccessfully - Gradually increase or reduce the performance threshold until no more improvements are visible while obtaining
COMPLETEDresults