Distillation is a customization process in Amazon Bedrock that transfers knowledge from a larger teacher model to a smaller, faster, and more cost-efficient student model by fine-tuning the student model with synthesized responses generated by Amazon Bedrock from the teacher model. Supervised fine-tuning adjusts parameters based on labeled prompt-response pairs directly, while reinforcement fine-tuning uses reward functions to align models.
In Amazon Bedrock, charges for model training are calculated based on the number of tokens processed (training corpus tokens multiplied by the number of epochs), while model storage is charged monthly per model.
Reinforcement fine-tuning aligns foundation models via feedback-based learning using reward functions defined in AWS Lambda instead of labeled prompt-response pairs. Users provide training prompt datasets or Bedrock invocation logs.
Amazon Bedrock automates the model distillation process to transfer knowledge from a larger, more intelligent teacher model to a smaller, faster, and more cost-efficient student model by generating responses from the teacher and using them to fine-tune the student.
Amazon Bedrock model customization charges are based on the number of processed tokens, which is calculated as the tokens in the training corpus multiplied by the number of epochs, along with model storage charged per month per model.
Reinforcement fine-tuning in Amazon Bedrock relies on feedback-based learning and reward functions (which can be defined using AWS Lambda) instead of using labeled input-output pairs.
Supervised fine-tuning in Amazon Bedrock adjusts model parameters by utilizing a training dataset of labeled examples to help the model learn the association between inputs and expected outputs.
A machine learning practitioner wants to transfer knowledge from a larger, highly accurate foundation model to a smaller, faster, and more cost-efficient model using Amazon Bedrock. Which customization process should they use, and how does it function?
How confident are you in this answer?