Luminesce and Lumipy

Luminesce is a data virtualization engine for LUSID and other applications. It is proprietary technology designed and developed by FINBOURNE Technology Limited. Understanding the Luminesce platform architecture.

Luminesce enables you to query multiple sources of business intelligence simultaneously in real-time—including investment management data stored in LUSID itself—and build a consolidated picture for analysis, optionally writing data back into LUSID. Alternatively, you can use Luminesce in a standalone capacity, without interacting with LUSID at all.

Data virtualization means you don’t have to extract, transform and load data into a data warehouse or lake, with all the attendant cost, complexity and obsolescence issues. You don’t have to worry about data in multiple sources being in different formats or conforming to different models. You can query any number of data sources for which Luminesce providers exist in situ, using either our set of SQL-based tools or your own familiar BI app such as Power BI, Tableau or Excel. We supply providers for LUSID and other popular external data sources, or you can create your own.

If you are a LUSID user, and providing you have an appropriate license and access control permissions, you can interact with Luminesce using the LUSID web app, via the Data Virtualisation menu:

Explanation: See the big picture

• Understanding the Luminesce platform architecture

Tutorials: Get started by doing something tangible

• Getting started: Retrieving a portfolio valuation

• Creating policies to control access to providers for different Luminesce users

Reference: Understand concepts and implications

• What tools are available to write Luminesce queries?

• What are a data provider and a direct provider?

• Understanding the Luminesce SQL query syntax

• Supported functions in Luminesce SQL queries

• Luminesce SQL keywords

• Using Luminesce to write different kinds of property for LUSID entities

• Providers supplied by FINBOURNE:

  Reading/writing LUSID investment data (Lusid.* providers)	Reading/writing Drive files (Drive.* providers)	Reading/writing SFTP server files (Sftp.* providers)
  Reading/writing local files (NAS) (LocalFs.* providers)	Reading/writing to SQL databases (The Sql.Db.Mine template provider)	Reading/writing to the Notification Service (Notification.* providers)
  Reading/writing to the Configuration Store (ConfigStore.* providers)	Reading/writing to the Scheduler (Scheduler.* providers)	Reading/writing to the Workflow Service (Workflow.* providers)
  Administering Luminesce itself (Sys.* providers)	Supporting functionality (Tools.* providers)	Creating custom views (The Sys.Admin.SetupView template provider)
  Writing to emails (Email.Send)

• Installing the Power BI Connector to connect Power BI Desktop to Luminesce

• Installing the standalone Windows ODBC driver to connect BI apps to Luminesce

• Installing the Windows DBC server and JDBC/ODBC client drivers to connect BI apps to Luminesce

• Enabling SSL to secure Windows DBC server and ODBC/JDBC client communications

• Caching Luminesce query results from BI apps for faster execution

• Using query folding to optimise Luminesce queries in Power BI Desktop

• Managing certificates for Luminesce providers

How-to guides: Get something done

• How do I configure Luminesce entity providers to read/write properties?

• How do I use Luminesce to read/write custom entities?

• How do I schedule a Luminesce query to run at a set time or on a regular basis?

• How do I use BI apps such as PowerBI or Excel to interact with Luminesce?

• How do I use Lumipy to interact with Luminesce?

• How do I use Lumipy to create data providers in Python?

• How do I use the Luminesce CLI?

• How do I see dependencies for Luminesce providers and custom views?