Product Updates June 27, 2024

Alkymi offers investment managers self-contained LLMs in secure private clouds

by Harald Collet

Website Ring Fenced LL Ms 2

Today Alkymi is announcing a new private cloud solution for use with Alkymi-hosted, ring-fenced large language models (LLMs), to further enable financial services firms to integrate generative AI into their workflows with greater security for their data.

The unique obstacles presented by financial services around security, confidentiality, and regulatory compliance have made it challenging for firms to take advantage of LLMs and generative AI to their full potential, such as requirements for encrypted and geo-fenced data or restrictions on use of third-party LLMs with customer data.

Expanding on our continued work to make generative AI secure for financial services, our new solution provides customers with a private cloud environment to use self-contained LLMs with their unstructured investment data. This enables firms to use generative AI with the assurance that no data leaves the secure environment and no external services are used. Firms have the option to utilize Alkymi-hosted LLMs such as Llama 3, Mistral, or a model fine-tuned on their data. Additional LLM choices will be made available as new models are released, ensuring firms have continuous access to the latest cutting-edge technology. Alkymi-hosted LLMs are ring-fenced with guardrails to ensure no third-party has access to the firm’s data.

Alkymi offers private cloud deployments using both AWS or Google Cloud Platform, extending access to secure, isolated environments to companies in North America, the EU, the Middle East, and APAC.

Utilizing Alkymi’s platform within a private cloud environment gives customers access to all of our investment document processing functionality within a dedicated environment for their firm. The platform provides several additional security measures including:

  • Data encryption at rest and in transit utilizing AES-256 standards and in compliance with FIPS 140-2 Level 3
  • FIPS 140-2 Level 3 certified Hardware Security Modules (HSMs) to safeguard cryptographic keys
  • Annual penetration testing and SOC2 Type 2 examination
  • Configurable data retention policies

With the additional security of a private cloud and access to the latest models for LLM-powered document understanding, customers can deploy a future-proof solution into their business workflows even more confidently, transforming use cases such as ESG, equity research, offering memorandums, LPAs, PPMs, and more.

Since launching LLMs within our platform in 2023, Alkymi has been laser-focused on leveraging the latest technologies while upholding strong security standards. This new private cloud solution ensures all firms can benefit from LLMs in their workflows while meeting their data privacy and regulatory compliance requirements.

More from the blog

October 10, 2024

Why firms should prioritize automating their data workflows

by Elizabeth Matson

Introducing a platform to automate your data workflows will increase efficiency and save time—but that’s not the only impact it can have on your firm.

October 3, 2024

Speed up CIM review with LLMs

by Elizabeth Matson

Reviewing a stack of CIMs can be painful, but it doesn’t have to be. Here's how we redesigned a CIM review workflow using large language models.

September 25, 2024

Applying AI in private markets: highlights from our Boston Happy Hour

by Elizabeth Matson

We hosted top investment ops leaders in Boston, featuring panelists from HarbourVest, Liberty Mutual Investments, and Cutter Associates. Read our highlights.