Synopse Open Source

2011-07-01

SynOleDB: OpenSource Unit for direct access to any database via OleDB

By AB4327-GANDI, 2011-07-01. Open Source › mORMot Framework

That's it, our SynOleDB unit seems alive and running well.

OLE DB (Object Linking and Embedding, Database, sometimes written as OLEDB or OLE-DB) is an API designed by Microsoft for accessing data from a variety of sources in a uniform manner. It was designed as a higher-level replacement for, and successor to, ODBC, extending its feature set to support a wider variety of non-relational databases, such as object databases and spreadsheets that do not necessarily implement SQL.

SynOleDB unit implementation has been made with several points in mind:

Tested with SQL Server 2008 R2 and Oracle 11g providers from Microsoft and Oracle;
Ability to be truly Unicode, even with pre-Unicode version of Delphi (like Delphi 7 or 2007);
Could access any local or remote Database, from any version of Delphi, since it doesn't use the DB.pas unit or any related part of the VCL (even the Delphi 7 personal or the Turbo Explorer editions), just for free;
Handle NULL or BLOB content for parameters and results;
Avoid most memory copy or unnecessary allocation: we tried to access the data directly from the retrieved data buffer, just as given from OleDB;
Was therefore designed to achieve the best performance possible: most time is spent in OleDB: the code layer added to the OleDB customer is very thin;
True OOP architecture, to be used with any OleDB provider (allowing custom parameters or such), and even without OleDB (in the future, direct access to any DB client could be used);
Could be safely used in a multi-threaded application/server (with one TOleDBConnection per thread);
Allow parameter bindings of requests, with fast access to any parameter or column name (thanks to TDynArrayHashed);
Late binding of column values in Delphi code;
Direct JSON content creation, with no temporary data copy nor allocation;
Designed to be used with our mORMot ORM, but could be used stand-alone (a full Delphi 7 client executable is just about 200 KB), or even in any existing Delphi application, thanks to a TQuery-like wrapper.

2011-06-29

Synopse SQLite3 framework 1.14

By AB4327-GANDI, 2011-06-29. Open Source › mORMot Framework

Our ORM framework has been released as version 1.14.

It's mainly a bug-fix release:

Integrated SQLite3 engine updated to latest version 3.7.7.1;
Fix several issues about JSON generation layout;
Enhanced automated User Interface generation for object on-screen edition;
SynPdf unit now handles Bézier curves from TCanvas, and some CMYK functions; also enhanced PDF/A-1compatibility;
Some speed enhancements, and new functions for the SynOleDB unit.

2011-06-16

Which Delphi compiler produces faster code?

By AB4327-GANDI, 2011-06-16. Pascal Programming

After a question on StackOverflow, I wanted to comment about the speed of generated code by diverse Delphi compiler versions.

Since performance matters when we write general purpose libraries like ours, we have some feedback to propose:

The 4,500,000 unitary tests of our SQlite3 ORM Framework;
The SynLZ compression algorithm.

2011-06-07

Intercepting exceptions: a patch to rule them all

By AB4327-GANDI, 2011-06-07. Pascal Programming

In order to let our TSynLog logging class intercept all exceptions, we use the low-level global RtlUnwindProc pointer, defined in System.pas.

Alas, under Delphi 5, this global RtlUnwindProc variable is not existing. The code calls directly the RtlUnWind Windows API function, with no hope of custom interception.

Two solutions could be envisaged:

Modify the Sytem.pas source code, adding the new RtlUnwindProc variable, just like Delphi 7;
Patch the assembler code, directly in the process memory.

The first solution is simple. Even if compiling System.pas is a bit more difficult than compiling other units, we already made that for our Enhanced RTL units. But you'll have to change the whole build chain in order to use your custom System.dcu instead of the default one. And some third-party units (only available in .dcu form) may not like the fast that the System.pas interface changed...

So we used the second solution: change the assembler code in the running process memory, to let call our RtlUnwindProc variable instead of the Windows API.

True per-class variable

By AB4327-GANDI, 2011-06-07. Pascal Programming

For our ORM, we needed a class variable to be available for each TSQLRecord class type.

This variable is used to store the properties of this class type, i.e. the database Table properties (e.g. table and column names and types) associated with a particular TSQLRecord class, from which all our ORM objects inherit.

The class var statement was not enough for us:
- It's not available on earlier Delphi versions, and we try to have our framework work with Delphi 6-7 up to XE;
- This class var instance will be shared by all classes inheriting from the class where it is defined - and we need ONE instance PER class type, not ONE instance for ALL

We needed to find another way to implement this class variable.

An unused VMT slot in the class type description was identified, then each class definition was patched in the process memory to contain our class variable.

2011-06-06

Synopse PDF Engine 1.13

By AB4327-GANDI, 2011-06-06. Open Source › Synopse PDF engine

Our SynPdf unit has been refreshed to the 1.13 version.

code modifications to compile with Delphi 5 compiler;
added horizontal scaling for GDI enumeration in case of text kerning (could occur for small fonts);
fixed "Save when closing with Acrobat Reader X" - thanks to Ondrej for the fix;
fixed clipping problems and vertical font positioning issue in GDI enumeration - thanks to Ondrej for those corrections!

Our pdf engine sounds almost stable by now.
Thanks to the feedback provided by some user of this Open Source library!

2011-06-05

Synopse SQLite3 Framework 1.13

By AB4327-GANDI, 2011-06-05. Open Source › mORMot Framework

This is a major step for the framework.

Among a lot of new features and bug fixes:

Dynamic arrays and Record handling, including low-level access and high-level handling for the ORM part of the framework (using TDynArray wrapper);
Business rules now handled via filtering and validating classes for both our ORM and the Synopse Big Table;
New full-featured logging classes, with exception handling, stack trace and JSON serialization;
Custom SQL functions and TSQLRecordRTree to implement R-Tree virtual tables;
Batch sequences for adding/updating/deleting multiple records;
Secure RESTful authentication via per-user light sessions, and per-query signature;
Define custom Virtual Tables (i.e. access any kind of data from SQL) in Delphi code;
New HTTP server using fast http.sys kernel-mode server and zip / SynLZ compression;
SynTaskDialog unit native under Vista,Seven with emulation code under XP/2000 ;
User Interface automated Generation using standard VCL or proprietary TMS components;
Documentation completed - more than 600 pages by now, including general User Guide and exhaustive Technical Reference;
Updated SQLite3 database engine to version 3.7.6.3;
Numerous bug fixes, speed and feature enhancements (including in the PDF and other UI-related units).

Open Source project, for Delphi 6 up to XE, licensed under a MPL/LGPL/GPL tri-license.

2011-06-02

Custom SQL functions

By AB4327-GANDI, 2011-06-02. Open Source › mORMot Framework

The SQLite3 engine defines some standard SQL functions, like abs() min() max() or upper().
A complete list is available at http://www.sqlite.org/lang_corefunc.html

One of the greatest SQLite3 feature is the ability to define custom SQL functions in high-level language. In fact, its C API allows to implement new functions which may be called within a SQL query. In other database engine, such functions are usually named UDF (for User Defined Functions).

Our framework allows you to add easily such custom functions, directly from Delphi classes.

no trackbacks