Product Updates June 27, 2024

Alkymi offers investment managers self-contained LLMs in secure private clouds

by Harald Collet

Website Ring Fenced LL Ms 2

Today Alkymi is announcing a new private cloud solution for use with Alkymi-hosted, ring-fenced large language models (LLMs), to further enable financial services firms to integrate generative AI into their workflows with greater security for their data.

The unique obstacles presented by financial services around security, confidentiality, and regulatory compliance have made it challenging for firms to take advantage of LLMs and generative AI to their full potential, such as requirements for encrypted and geo-fenced data or restrictions on use of third-party LLMs with customer data.

Expanding on our continued work to make generative AI secure for financial services, our new solution provides customers with a private cloud environment to use self-contained LLMs with their unstructured investment data. This enables firms to use generative AI with the assurance that no data leaves the secure environment and no external services are used. Firms have the option to utilize Alkymi-hosted LLMs such as Llama 3, Mistral, or a model fine-tuned on their data. Additional LLM choices will be made available as new models are released, ensuring firms have continuous access to the latest cutting-edge technology. Alkymi-hosted LLMs are ring-fenced with guardrails to ensure no third-party has access to the firm’s data.

Alkymi offers private cloud deployments using both AWS or Google Cloud Platform, extending access to secure, isolated environments to companies in North America, the EU, the Middle East, and APAC.

Utilizing Alkymi’s platform within a private cloud environment gives customers access to all of our investment document processing functionality within a dedicated environment for their firm. The platform provides several additional security measures including:

  • Data encryption at rest and in transit utilizing AES-256 standards and in compliance with FIPS 140-2 Level 3
  • FIPS 140-2 Level 3 certified Hardware Security Modules (HSMs) to safeguard cryptographic keys
  • Annual penetration testing and SOC2 Type 2 examination
  • Configurable data retention policies

With the additional security of a private cloud and access to the latest models for LLM-powered document understanding, customers can deploy a future-proof solution into their business workflows even more confidently, transforming use cases such as ESG, equity research, offering memorandums, LPAs, PPMs, and more.

Since launching LLMs within our platform in 2023, Alkymi has been laser-focused on leveraging the latest technologies while upholding strong security standards. This new private cloud solution ensures all firms can benefit from LLMs in their workflows while meeting their data privacy and regulatory compliance requirements.

More from the blog

July 18, 2024

Applied AI strategies for private markets: takeaways from our NYC Happy Hour

by Elizabeth Matson

We were thrilled to host top investment operations executives for an evening of insightful discussion. Read our key takeaways and highlights from the night.

July 11, 2024

Leverage AI to attract and retain top-tier analysts

by Elizabeth Matson

Attracting and retaining skilled analysts is increasingly challenging for financial services firms. Read how firms can have an advantage in today's job market.

June 12, 2024

Zen and the art of portal retrieval: automating your document ingestion

by Elizabeth Matson

We weigh the pros and cons of the most common options for managing retrieving your documents from portals and data rooms and propose a unified solution.