Home Home
Data Management Training Inference GenAI Managed Services
Lore SDK AIOLI SDK Pachyderm SDK
GenAI
  • Admin
    • Cluster Setup
      • Reference
        • Cluster Usage Reference
          • Supported Hardware Reference
            • Inference Reference
              • Fine-Tuning Reference
              • Cluster Deployment Guides
                • Set Up an MLDES Cluster
                  • Deploy on AWS
                    • Set Up and Manage an AWS EC2 Cluster
                    • Deploy on Kubernetes
                      • Google Kubernetes Engine (GKE) Cluster
                        • On-Prem Kubernetes Cluster
                          • Enforce Shared User Agent Group IDs
                      • Organizations and User Accounts
                        • Create Users
                          • Manage Users
                            • Deactivate a User
                              • Create an Organization
                              • Known Issues and Debugging
                              • Get Started
                                • First-Time Sign In
                                  • Quickstarts
                                    • Summarization and Classification
                                      • Simple Q&A
                                      • Set Hugging Face Access Token
                                        • Intro to Prompt Engineering
                                          • What is a Prompt?
                                            • Simple Prompts
                                              • Advanced Prompts
                                              • Glossary
                                                • Batch Inference
                                                  • Checkpoint
                                                    • Context Understanding
                                                      • Dataset
                                                        • Evaluation Experiment
                                                          • Few-Shot Prompting
                                                            • Fine-Tuned Model
                                                              • Foundation Model
                                                                • Generative AI
                                                                  • Generative AI Chatbot
                                                                    • Hugging Face
                                                                      • LLM
                                                                        • Max New Tokens
                                                                          • Model Properties
                                                                            • Natural Language Processing (NLP)
                                                                              • Online Inference
                                                                                • Prompt
                                                                                  • Prompt Engineering
                                                                                    • Retrieval Augmented Generation (RAG)
                                                                                      • Session
                                                                                        • Snapshot
                                                                                          • System Output
                                                                                            • Temperature
                                                                                              • Token
                                                                                                • Top K
                                                                                                  • Top P
                                                                                                    • Training Experiment
                                                                                                      • Variant
                                                                                                    • Tutorials
                                                                                                      • News Summarization
                                                                                                        • Create Project
                                                                                                          • Prepare Data
                                                                                                            • Load Base Model
                                                                                                              • Prompt the Model
                                                                                                                • Improve the Results
                                                                                                                  • Provide Examples by Linking a Dataset
                                                                                                                  • Text to SQL
                                                                                                                    • Generate SQL Queries
                                                                                                                      • Fine Tune
                                                                                                                        • Test Fine-Tuned Model
                                                                                                                          • Push Your Fine-Tuned Model to HF
                                                                                                                          • Customer Complaints Classification
                                                                                                                            • Craft a Simple Prompt
                                                                                                                              • Provide Examples and Link a Dataset
                                                                                                                                • Craft a Complex Prompt
                                                                                                                                  • Fine Tune
                                                                                                                                    • Test Fine-Tuned Model
                                                                                                                                      • Push Your Fine-Tuned Model to HF
                                                                                                                                      • Medical Transcripts Classification
                                                                                                                                        • Create Project & Load Data
                                                                                                                                          • Load Base Model
                                                                                                                                            • Prompt the Model
                                                                                                                                              • Fine-Tune From a Snapshot
                                                                                                                                                • Test Fine-Tuned Model
                                                                                                                                                  • Push Your Fine-Tuned Model to HF
                                                                                                                                                • RAG
                                                                                                                                                  • Create a Notebook for Building Your RAG Application
                                                                                                                                                    • Generate RAG Responses
                                                                                                                                                      • Use Case - Building a Retrieval Augmented Generation (RAG) Pipeline (featuring LlamaIndex)
                                                                                                                                                      • Lore Python SDK
                                                                                                                                                        • Client Initialization (Start Here)
                                                                                                                                                          • Using MLIS and Third-Party Models in GenAI Notebooks
                                                                                                                                                            • Workspaces
                                                                                                                                                              • Datasets
                                                                                                                                                                • Prompt Templates
                                                                                                                                                                  • Models
                                                                                                                                                                    • Full Package Reference
                                                                                                                                                                    • Notebooks
                                                                                                                                                                      • Launch Notebook (CLI)
                                                                                                                                                                        • Launch Notebook (GUI)
                                                                                                                                                                          • Using MLIS and Third-Party Models in GenAI Notebooks
                                                                                                                                                                          • Fine-Tuning
                                                                                                                                                                            • About Fine-Tuning
                                                                                                                                                                              • How to Fine-Tune a Model
                                                                                                                                                                                • Kill a Job in Progress
                                                                                                                                                                                  • Delete a Job
                                                                                                                                                                                    • How to Use PEFT
                                                                                                                                                                                    • Projects
                                                                                                                                                                                      • Snapshot Mode
                                                                                                                                                                                        • Manage Snapshots
                                                                                                                                                                                          • Project Settings
                                                                                                                                                                                          • Datasets
                                                                                                                                                                                            • Local File Upload Size Limitations
                                                                                                                                                                                            • Models
                                                                                                                                                                                              • Compare Base Models
                                                                                                                                                                                                • List
                                                                                                                                                                                                  • Test
                                                                                                                                                                                                    • Export
                                                                                                                                                                                                      • Download
                                                                                                                                                                                                        • Push to Hugging Face

                                                                                                                                                                                                      News Summarization

                                                                                                                                                                                                      Learn how to summarize news articles using generative AI.

                                                                                                                                                                                                      1. Create Project

                                                                                                                                                                                                      Initiate your news summarization project.

                                                                                                                                                                                                      2. Prepare Data

                                                                                                                                                                                                      Organize and understand your datasets for effective model training.

                                                                                                                                                                                                      3. Load Base Model

                                                                                                                                                                                                      Choose and configure a base model to integrate with your dataset.

                                                                                                                                                                                                      4. Prompt the Model

                                                                                                                                                                                                      Use custom prompts to generate summaries and save your configurations for future use.

                                                                                                                                                                                                      5. Improve Results

                                                                                                                                                                                                      Apply methods for achieving more consistent results.

                                                                                                                                                                                                      6. Provide Examples by Linking a Dataset

                                                                                                                                                                                                      Learn how to improve your model by providing examples via a linked dataset.