Home Home
Data Management Training Inference GenAI Managed Services
Lore SDK AIOLI SDK Pachyderm SDK
GenAI
  • Admin
    • Cluster Setup
      • Reference
        • Cluster Usage Reference
          • Supported Hardware Reference
            • Inference Reference
              • Fine-Tuning Reference
              • Cluster Deployment Guides
                • Set Up an MLDES Cluster
                  • Deploy on AWS
                    • Set Up and Manage an AWS EC2 Cluster
                    • Deploy on Kubernetes
                      • Google Kubernetes Engine (GKE) Cluster
                        • On-Prem Kubernetes Cluster
                          • Enforce Shared User Agent Group IDs
                      • Organizations and User Accounts
                        • Create Users
                          • Manage Users
                            • Deactivate a User
                              • Create an Organization
                              • Known Issues and Debugging
                              • Get Started
                                • First-Time Sign In
                                  • Quickstarts
                                    • Summarization and Classification
                                      • Simple Q&A
                                      • Set Hugging Face Access Token
                                        • Intro to Prompt Engineering
                                          • What is a Prompt?
                                            • Simple Prompts
                                              • Advanced Prompts
                                              • Glossary
                                                • Batch Inference
                                                  • Checkpoint
                                                    • Context Understanding
                                                      • Dataset
                                                        • Evaluation Experiment
                                                          • Few-Shot Prompting
                                                            • Fine-Tuned Model
                                                              • Foundation Model
                                                                • Generative AI
                                                                  • Generative AI Chatbot
                                                                    • Hugging Face
                                                                      • LLM
                                                                        • Max New Tokens
                                                                          • Model Properties
                                                                            • Natural Language Processing (NLP)
                                                                              • Online Inference
                                                                                • Prompt
                                                                                  • Prompt Engineering
                                                                                    • Retrieval Augmented Generation (RAG)
                                                                                      • Session
                                                                                        • Snapshot
                                                                                          • System Output
                                                                                            • Temperature
                                                                                              • Token
                                                                                                • Top K
                                                                                                  • Top P
                                                                                                    • Training Experiment
                                                                                                      • Variant
                                                                                                    • Tutorials
                                                                                                      • News Summarization
                                                                                                        • Create Project
                                                                                                          • Prepare Data
                                                                                                            • Load Base Model
                                                                                                              • Prompt the Model
                                                                                                                • Improve the Results
                                                                                                                  • Provide Examples by Linking a Dataset
                                                                                                                  • Text to SQL
                                                                                                                    • Generate SQL Queries
                                                                                                                      • Fine Tune
                                                                                                                        • Test Fine-Tuned Model
                                                                                                                          • Push Your Fine-Tuned Model to HF
                                                                                                                          • Customer Complaints Classification
                                                                                                                            • Craft a Simple Prompt
                                                                                                                              • Provide Examples and Link a Dataset
                                                                                                                                • Craft a Complex Prompt
                                                                                                                                  • Fine Tune
                                                                                                                                    • Test Fine-Tuned Model
                                                                                                                                      • Push Your Fine-Tuned Model to HF
                                                                                                                                      • Medical Transcripts Classification
                                                                                                                                        • Create Project & Load Data
                                                                                                                                          • Load Base Model
                                                                                                                                            • Prompt the Model
                                                                                                                                              • Fine-Tune From a Snapshot
                                                                                                                                                • Test Fine-Tuned Model
                                                                                                                                                  • Push Your Fine-Tuned Model to HF
                                                                                                                                                • RAG
                                                                                                                                                  • Create a Notebook for Building Your RAG Application
                                                                                                                                                    • Generate RAG Responses
                                                                                                                                                      • Use Case - Building a Retrieval Augmented Generation (RAG) Pipeline (featuring LlamaIndex)
                                                                                                                                                      • Lore Python SDK
                                                                                                                                                        • Client Initialization (Start Here)
                                                                                                                                                          • Using MLIS and Third-Party Models in GenAI Notebooks
                                                                                                                                                            • Workspaces
                                                                                                                                                              • Datasets
                                                                                                                                                                • Prompt Templates
                                                                                                                                                                  • Models
                                                                                                                                                                    • Full Package Reference
                                                                                                                                                                    • Notebooks
                                                                                                                                                                      • Launch Notebook (CLI)
                                                                                                                                                                        • Launch Notebook (GUI)
                                                                                                                                                                          • Using MLIS and Third-Party Models in GenAI Notebooks
                                                                                                                                                                          • Fine-Tuning
                                                                                                                                                                            • About Fine-Tuning
                                                                                                                                                                              • How to Fine-Tune a Model
                                                                                                                                                                                • Kill a Job in Progress
                                                                                                                                                                                  • Delete a Job
                                                                                                                                                                                    • How to Use PEFT
                                                                                                                                                                                    • Projects
                                                                                                                                                                                      • Snapshot Mode
                                                                                                                                                                                        • Manage Snapshots
                                                                                                                                                                                          • Project Settings
                                                                                                                                                                                          • Datasets
                                                                                                                                                                                            • Local File Upload Size Limitations
                                                                                                                                                                                            • Models
                                                                                                                                                                                              • Compare Base Models
                                                                                                                                                                                                • List
                                                                                                                                                                                                  • Test
                                                                                                                                                                                                    • Export
                                                                                                                                                                                                      • Download
                                                                                                                                                                                                        • Push to Hugging Face
                                                                                                                                                                                                      Products GenAI Docs Admin Cluster Setup Cluster...

                                                                                                                                                                                                      Deploy on AWS #

                                                                                                                                                                                                      To understand how Machine Learning Development Environment runs on AWS, visit Deploy on AWS.

                                                                                                                                                                                                      Set Up and Manage an AWS EC2 Cluster

                                                                                                                                                                                                      Learn how to install GenAI on an AWS EC2 instance.

                                                                                                                                                                                                      • Previous placeholder
                                                                                                                                                                                                      • Next placeholder