Release Notes Highlights for MLDM

• Enhancement: Updated to Go 1.22.2 and latest x/net.
• Enhancement: pinned Pachyderm-SDK versino to >=2.8.0<2.9.0 for the Jupyter Mount Extension.
• Enhancement: Upgraded to Envoy 1.27.4

• Enhancement: The Jupyter Mount Extension is now FUSE-less. This means that the Jupyter Mount Extension no longer requires FUSE to be installed on the host machine.
• Enhancement: We’ve migrated to using goCDK to handle blob storage configuration in the Helm chart. This means that you can now use storage URLs and pass in supported query parameters for easy setup.

• Enhancement: General updates to the Console UI, including updated status icons for in-progress jobs.
• Fix: Resolved an issue where pachctl put file incorrectly placed files with directory prefix instead of at the branch root.

• Enhancement: The Console now displays a visual distinction between the different types of pipelines and repos.
• Fix: Resolved an issue where the Console did not display which version was running.
• Fix: Resolved an issue where the Jupyter Mount Extension would report the wrong download path for datums.

• Enhancement: Refactored the Console’s Explore View.
• Enhancement: You can now adjust the Refecth Interval rate for Console in the Helm Chart.
• New Feature: You can now set roles on the Cluster level from within Console.

• Enhancement: Updated to Go 1.22.2 and latest x/net.
• Enhancement: Upgraded to Envoy 1.27.4
• Fix: Resolved issue in Console where proxy port caused issues with downloading files.
• Feature: Added new args to debug dumps. You can review the full debug template by running pachctl debug template in the CLI.

Full Default Debug template #

$ pachctl debug template
defaults:
    clusterDefaults: true
inputRepos: true
starlarkScripts:
    - builtin: starlark/basic.star
      timeout: 60s
    - builtin: starlark/list_rcs.star
      timeout: 60s
system:
    database: true
    describes:
        - name: console                                                                                                                                                                                                                                                     - name: etcd
        - name: pachd
        - name: pachyderm-kube-event-tail
        - name: pachyderm-proxy
        - name: pg-bouncer
    helm: true
    logs:
        - name: console
        - name: etcd
        - name: pachd
        - name: pachyderm-kube-event-tail
        - name: pachyderm-proxy
        - name: pg-bouncer
    lokiLogs:
        - lokiArgs:
            maxLogs: "30000"
          name: console
        - lokiArgs:
            maxLogs: "30000"
          name: etcd
        - lokiArgs:
            maxLogs: "30000"
          name: pachd
        - lokiArgs:
            maxLogs: "30000"
          name: pachyderm-kube-event-tail
        - lokiArgs:
            maxLogs: "30000"
          name: pachyderm-proxy
        - lokiArgs:
            maxLogs: "30000"
          name: pg-bouncer
    profiles:
        - name: pachd
          profileArgs:
            profiles:
                - name: heap
                - name: goroutine
    version: true

• Enhancement: Colors in the Console’s file browser have been improved for accessibility.
• Enhancement: Console’s callback page now properly redirects to the original page after login instead of redirecting to the home page (/).
• Enhancement: The visualization of the DAG in Console have been improved for better sizing and scaling with your browser window.
• Fix Resolved a bug where pipeline and job statuses were not correctly displaying.