Problems importing an OO database into LO

Hi all,

The easiest improvements in my honest opinion:
- Wipe out the .odb container all together and get back to the
configuration of database access in OOo 1. Back to external databases
with configuration data in configuration files, forms and reports in
stand-alone office documents. More speed more safety, security,
accessibility and transparency. People who do not understand how to
connect separated software tools do not understand the .odb container
neither (as we can read in all the mail merge topics).
- Remove all the half done wizards. Do not improve them. Remove! No
database developer nor interface designer needs all this stinky rubbish.
There are graphical tools to compose forms and reports within office
documents. There is SQL for all the rest, including all the things we
can not do in the current graphical interface. There are plenty of SQL
editors to produce valid SQL for various databases. SQL text can be
pasted into any database configuration.
- Add native database queries, so the current "direct SQL mode" returns
editable row sets and the (useless or even harmful) graphical query
designer can be removed as well.
- Having removed all the wizards (they are Java components) without
losing any functionality at all, extensions could substitute .odb
packages. When you open the extension, the database gets installed
_permanently_ (rather than _temporarily_ like the .odb) into the
configuration tree together with the forms and reports documents. The
database will be registered and all the tables, queries, forms and
reports are accessible form the data source window, hyperlinks and
desktop links just like it used to be in OOo 1.

Ah, nostalgia those were halcyon days :wink:

+1 (not that that means anything in our "user land".

Unfortunately, as I was told quite a while ago either on the dev-list or
IRC dev channel, or bugzilla, "no-one wants to go back to 10 year old
technology", i.e. the LO devs are not interested in undoing what Sun it
its infinite wisdom thought would be a good idea when it "re-invented
OOo-Base", so we are stuck with what we have until someone steps up and
decides to either unravel it all or improve it - a mammoth task by
anyone's standards.

Alex

To my knowledge (which granted, may be limited), there is not a single
Base developer on the AOOo team. The integration of hsqldb2 had already
been prepared during Oracle's tenure, it was thereafter a matter of
integrating the child workspace of the relevant code. Moreover, AOOo
have dropped future bundling of the Oracle ReportBuilder extension
because of licensing problems with some of the Pentaho libraries, as
with the mysql native connector. In other words, the Base module in AOOo
is effectively at best stalled, at worst crippled with regard to OOo 3.3.x

Alex

Hi Ian,

While I might agree with your statements with regard to the integrated
use of HSQLDB, I would differ with regard to hooking up Base to various
server backends, which in my experience do work rather well on the
whole, albeit with tweaking, and are multi-OS compatible.

LONG story short........ I have now moved my (re-built) Database on to
Kexi - and what a difference!!!! It's like getting out of an old
broken-down VW (or other make) of car and getting into a brand new
Jaguar and driving down the highway at 100mph!! And I know what that
feels like as I did just that last year in the UK!! Yes there is a lot
to learn and work out but the overall effect is like Chalk and Cheese!!

For anyone interested I can recommend this DB - some of the more fancy
options are only due out in future releases but for a basic DB job it
"just works"!!

Is it multi-OS ? Can you create a db/form/query in Kexi and give it to a
Windows, Mac or Solaris user and then have that work ? If not, then it
is no better than Access, or Lotus Approach.

Alex

Hi :slight_smile:
I think Kexi and the rest of Calligra/KOffice has a Windows version just as LibreOffice does.  Calligra/KOffice uses ODF natively and presumably can use MS formats although i'm not sure quite how well. 
Regards from
Tom :slight_smile:

Hi Ian,

While I might agree with your statements with regard to the integrated
use of HSQLDB, I would differ with regard to hooking up Base to various
server backends, which in my experience do work rather well on the
whole, albeit with tweaking, and are multi-OS compatible.

Hi Alex - Yes I wanted to try this and everybody said it was easy but NOBODY gave me any instructions!! I did "mess about" with it a few times but got nowhere - so I never was able to try this out!!

Is it multi-OS ? Can you create a db/form/query in Kexi and give it to a
Windows, Mac or Solaris user and then have that work ? If not, then it
is no better than Access, or Lotus Approach.

Kexi is a standard SQLlight format so the files should be movable between OpSys-es. I also see that Calligra 2.4 has just been released that includes the latest Kexi and this is available on Window$ and they are asking for Mac OS Devs also!!

But non of this was a major concern of mine. I run my own DB and used it EVERY day. I don't have to pass it on to others so as long as it works for me (well) in Linux - that's what I need!!! And so far Kexi is delivering, (for me anyway!!).

All the best
Ian W
Pretoria

Hi :slight_smile:
The divergence has resulted in at least a doubling of the numbers of people working on the project(s).  The projects do have a lot of overlap and share a lot.  People that were colleagues working alongside each other may find themselves split into different projects but still chatting and helping each other.

Taking just LibreOffice alone, it has famously already had a vast amount of devs join in.  The "Easy hacks" initiative has made it far easier to get devs that are familiar with other projects familiarised with programming for LibreOffice.  It's helped draw in students and other people that have never really done any programming before or left programming years ago and "Google's Summer of Code" has helped draw people into programming for LO too.

Under Sun the infrastructure had all grown quite tangled so it was good to get a fresh start under TDF  maximising the usefulness of modern technology that simply wasn't around when Sun's infrastructure was originally planned.

The Apache Foundation is quite large and IBM can support their developments but would fidn it difficult to support a truly and fully OpenSource project such as LibreOffice.  Apparently Apache Licensing allows a mix of some fairly proprietary chunks of code alongside OpenSource ones.

If OOo had just carried on under Sun then it wouldn't have had the resources of either Apache nor TDF let alone both!!

Plus about half the community would have been unhappy about not being fully OpenSource and therefore never gaining the backing of the "Free Software Foundation" which has led to a greater range of distros being comfortable using LO.  The other half might have wanted to pull us more in the direction of corporate secrecy such as IBM seem to want.  This way both sides are happier and growing faster.

Regards from
Tom :slight_smile:

We are using OO-LO as a front end to connect to MySQL, we no longer use the LO-forms etc , but we usesDialogs and their controls (also Drids and the DataSourceBrowser)who are feeded with the MySQL-data.
Reporting is done by feeding WriterDocs with the data, or Calc-spreadsheets for data oriented reports. Exporting to a spreadsheet is very slow when feeding the sheet cell by cell. But using the "doimport" on a cell range is lightning fast.
  For Connecting, we use the NativeConnector. We trie to avoid using a OO-LO dbase doc(fro safty reasons) and connect directly using the DriverManager. This method has a important drawback, The DataSourceBrowser is not working without connecting with dbaseDoc.
when low volume selections (100 lines)using the GridControls is very use full but becomes to slow for big selections, here is the DataSource browser a possible workaround. GridControls however have the advantage that we can "color" every line, whats make it far more user friendly.
This system is used by 100 users , who can do all their tasks with only using OO-LO

Greetz

Fernand

Hi :slight_smile:
That sounds much easier for data-input and normal look-up use for normal users that are barely familiar with Word/Writer and Calc/Excel.

Most normal office workers seem scared of using databases for even low level tasks.  This style of use takes away the scary front-end and gives them something more familiar.

It sounds like a slightly tougher challenge for the designers in some ways but saves them endless time fiddling around lining up boxes on Forms and Reports.  If normal office workers can be allowed to do the fiddling then i think that suits everyone much better.

Regards from
Tom :slight_smile:

Hi :slight_smile:
That is exactly why i wondered if Andreas' points could be worked on while leaving the existing package, Base, as it stands.

That way the database functionality could be moved forwards while leaving the kludgy mess (ok, it might not be a kludge from a coders pov) to get sorted 'later'.

The trees outside my window have been severely pruned back but i know that by the summer the leaves will be out in full force.  The trees look a lot healthier already as they are not groaning under their own weight. 
Regards from
Tom :slight_smile:

I think Andreas' approach for end users is a very good idea.
I think, furthermore, that it starts to redefine how databases can be
used. that's a good thing and going dowm that track will, I'm sure,
lead to further developments.

As such, yes, I think it would be a great idea to push that approach.

I think that as an additional and separate approach, what is thought
of as "Base" now *should* be made more accessible and useful so that
the general populace *can* start to do things with data themselves.

Mark Stanton

> I'm almost thinking of installing something like MySQL and writing my own
> front-end in Java.

I'm sorry if I'm being slow, or not following the conversation properly (lots going
on here at the moment), but, if you're thinking like that, what's wrong with Base?
The things you'd need to do, Base does.
The things that approach won't get you, something to present your data, you'd
use Writer/Calc for.

The two problems I've registered (which have a multitude of subsidiaries, I know,
I'm not trying to say Base is great yet, it's clearly not), is that the whole thing
crashes, the answer is use a back end not the embedded system, and the wizards
are cr*p, building your own front end to (eg) MySQL won't help you there.

Andreas' approach of writing queries and setting up Writer documents to use them
does what you want, doesn't it?

Writing documentation for this approach would be a good idea to broadcase these
ideas.

Mark Stanton
One teeny-tiny step for mankind, apparently...

Mark Stanton wrote

> I'm almost thinking of installing something like MySQL and writing my
own
> front-end in Java.

I'm sorry if I'm being slow, or not following the conversation properly
(lots going
on here at the moment), but, if you're thinking like that, what's wrong
with Base?
The things you'd need to do, Base does.
The things that approach won't get you, something to present your data,
you'd
use Writer/Calc for.

The two problems I've registered (which have a multitude of subsidiaries,
I know,
I'm not trying to say Base is great yet, it's clearly not), is that the
whole thing
crashes, the answer is use a back end not the embedded system, and the
wizards
are cr*p, building your own front end to (eg) MySQL won't help you there.

Andreas' approach of writing queries and setting up Writer documents to
use them
does what you want, doesn't it?

Writing documentation for this approach would be a good idea to broadcase
these
ideas.

Mark Stanton

I think I'm being misunderstood here. I've never mentioned trying to link
Base and Word - that's not something I want to do. All I originally asked
about was an incorrect display of a query in a form. This has been ignored
in the general discussion on the suitability or Base as a general-purpose
user-oriented database front-end and in its future development. I've said my
two pen'orth on that subject, as I'm certainly not competent to discuss the
politics involved. So will shut up here.

Am 19.04.2012 13:00, ptoye wrote:

Mark Stanton wrote

I think I'm being misunderstood here. I've never mentioned trying to link
Base and Word - that's not something I want to do.

You do it all the time. All of your input forms are attached to Writer documents.

  All I originally asked

about was an incorrect display of a query in a form.

and you received at least two viable solutions although nobody was able to reproduce the problem.

Andreas Säger wrote

Am 19.04.2012 13:00, ptoye wrote:

I think I'm being misunderstood here. I've never mentioned trying to link
Base and Word - that's not something I want to do.

You do it all the time. All of your input forms are attached to Writer
documents.

  All I originally asked

about was an incorrect display of a query in a form.

and you received at least two viable solutions although nobody was able
to reproduce the problem.

One of the solutions was my own: to continue using OO (which at the moment I
am, but is not exactly a solution to the technical problem). The other was
your workaround.

No-one here said they couldn't reproduce it as far as I can see, though of
course it may be true. I'd be willing to upload the database here if anyone
would like to try it out on their system. It might be a configuration issue,
though I can't quite see how.

After the short discussion about the technical problem I had, this thread
turned into a discussion of the relationship between LO and OO, and of the
shortcomings (or otherwise) of Base, about which I am not qualified to
comment.

LibO-folks,

From this long and very interesting thread and some other discussions on this mailing list too, together with my own recent experiences, there is only one main conclusion to draw:

There is no real future forLibO's Base module, perhaps not for the whole LibO suite.

From a non-expert user's perspective there are in fact two versions of LibO-Base

A >a "Light-LibO-Base" => a package consisting of LibO-Base as a front-end GUI and an embedded db-engine HSQKDBv1.8. This package is (could be) suitable for up to medium complex databases and be used by 'ordinary' people (like me) who does not have own skills in programming or developing or in SQL or other languages (PHP, HTML, etc.) -- who plainly want to create a database following instructions mechanically

B > an "Advanced-LibO-Base => the LibO-Base module to be used as a front-end GUI connected to an external db-engine and that can be used by people with own knowledge in programming anddb-theories and SQL and who have a good knowledge of the whole LibO's build-up,preferable in the linux environment

The "Light-LibO-Base" will fail because it is like a car without a gear box: you can open it and start it but not use it as intended

Øthe installing procedure of Lib-O causes problems because of unclear instructions

Øthe LibO-Base module as a program is half done;even basic features does not work

Øthere is no documentation explicit for LibO-Base -- and will obviouslynot be;

Users have to rely on OpenO documentation why there is no logical reason to install LibO (ordinary new users does not know about any differences between LibO and OO -- and do not know why to seek)

Øthe LibreOffice Help is a disaster -- a user new to LibO does not get any (direct) help

Øthe embedded HSQLv1.8 is out-of-date and causes frustration and waste of time because the lack of easy to get and sufficient support

Øthe reports is a important part of the data output; there is no Report Builder explicit for LibO-Base or one that works properly

Øthese problems all together are too difficult and time wasting for a new user why he begins to look for easier ways to solve his need of a database, other than LibO-Base

Øthe BoD is not interested in investing in that part of users

The "Advanced-LibO-Base" will fail because:

Øthe Base module as a program is half done (as above) -- can be used only of that minority of users who have the skill to do their own programming to get around problems and failures

Øwho have the skill to use "real" externaldatabases (e.g. SQL)

Øthe connection LibO-Base óexternal db does not work (if not recently fixed)

Øthe BoD is not interested in investing in Base

In not so very far future -- if a total destruction is excluded - our whole world will be computerized, which means that every household must have a computer and at least the most necessary programs for communication (writing, mailing, internet) and calculating and perhaps databases. Most of these private households have to or will prefer to use freeware programs instead of commercials provided that the use is easy, free of any problems and does not require special skills.

The fact that MS is a 95% market leader has to be accepted; MS dictates the standards and it's products work well enough. The only real possibility for anyone to compete MSO is a free (low cost) and perfectly functioning product that gets a total acceptance by the children in these grass level households.

The application that these children get used to at home and in school will cause the real press on commercial programs also in business.

Considering a possible common aim to compete the commercials, it is a waste of valuable resources when open source developersoverlap or compete each others . Cooperate globally?

LibO can only hope that the BoD will review its strategy planning or change the members.

Best regards

Pertti Rönnberg

Am 19.04.2012 20:45, Pertti Rönnberg wrote:

LibO-folks,

From this long and very interesting thread and some other discussions
on this mailing list too, together with my own recent experiences, there
is only one main conclusion to draw:

There is no real future forLibO's Base module, perhaps not for the whole
LibO suite.

From a non-expert user's perspective there are in fact two versions of
LibO-Base

A >a "Light-LibO-Base" => a package consisting of LibO-Base as a
front-end GUI and an embedded db-engine HSQKDBv1.8. This package is
(could be) suitable for up to medium complex databases and be used by
'ordinary' people (like me) who does not have own skills in programming
or developing or in SQL or other languages (PHP, HTML, etc.) -- who
plainly want to create a database following instructions mechanically

B > an "Advanced-LibO-Base => the LibO-Base module to be used as a
front-end GUI connected to an external db-engine and that can be used by
people with own knowledge in programming anddb-theories and SQL and who
have a good knowledge of the whole LibO's build-up,preferable in the
linux environment

I can hardly see any difference between A and B. The embedded HSQLDB behaves exactly like an external DB. When you "open the embedded database document" you actually _install_ an external HSQLDB and connect the office suite to that _external_ database in cached mode (single user on local machine) until you "close the database document" which re-packages the external database.
IMHO, nobody needs to know anything about macro programming in order to build useful database applications with Base. The vast majority of Base macros are due to bad database design, save one or two clicks or they are made to impress the boss.
There are plenty of macros for generic tasks. All the most desperately wanted macros have been written already (clone records, refresh this and that, open forms and reports, open text as hyperlink).
What I would describe as "Base light" is the ability to use spreadsheets, csv files, dBase files, LDAP and popular mail client address books as read-only data sources for office documents, mostly mail merge.
This is the most important feature and the concept is superior to MS Office if there is a computer knowledgable administrator able to work with templates, spreadsheets, plain text and some SQL in a creative manner. For the end user who writes a serial letter the type of data source makes no difference at all. It is always used in the same (slightly clumsy) way, no matter if the addresses come from Oracle server or plain text file.

The "Light-LibO-Base" will fail because it is like a car without a gear
box: you can open it and start it but not use it as intended

Øthe installing procedure of Lib-O causes problems because of unclear
instructions

Øthe LibO-Base module as a program is half done;even basic features does
not work

Base is not a stand-alone program and all the _basic_ features do work well. The database backend is a mature database program, most of the rest belongs to the Writer component.
There is just too much dysfunctional junk on top of the basic database functionality which does not add any additional functionality. Everything that the wizards are supposed to do can be done without the wizard.
Today's users are do not accept any _basic_ features in a highly sophisticated office suite, no matter how well the basic features use to work. Instead they complain about the dysfunctional rubbish.

Øthere is no documentation explicit for LibO-Base -- and will
obviouslynot be;

There is excellent documentation for OOo Base which is identical to LibO Base. Main problem with documentation is that today's computer users overestimate their skills and do not understand the difference between end user applications and development tools. This type of office suite suggest that each component should be as easy to use as the text processor.

Users have to rely on OpenO documentation why there is no logical reason
to install LibO (ordinary new users does not know about any differences
between LibO and OO -- and do not know why to seek)

Øthe LibreOffice Help is a disaster -- a user new to LibO does not get
any (direct) help

LibO documentation on Base is plain wrong and misleading. Simply point to the existing OOo docs or copy and paste that stuff.

Øthe embedded HSQLv1.8 is out-of-date and causes frustration and waste
of time because the lack of easy to get and sufficient support

There are not many users who suffer from the limited capabilities of HSQL1.8. A high risk of total data loss is the main reason why one must not use the embedded database. Getting an embedded database out of the jail is easy enough.

Øthe reports is a important part of the data output; there is no Report
Builder explicit for LibO-Base or one that works properly

Calc is a very good sorrogate for a report engine even if you are not very familiar with spreadsheets. It supports charts, pivot tables, conditional formatting and more.
The old report engine for Writer is still there. We can open "old style reports" that have been created without Report Builder. Unfortunately the bundled Report Builder extension makes the old report tool inaccessible.
You may try to disable the extension and create a new report then. I forgot how to disable bundled extensions. So I can't try right now.

Øthese problems all together are too difficult and time wasting for a
new user why he begins to look for easier ways to solve his need of a
database, other than LibO-Base

The average office user can not design databases anyway. MS Access users rely on a heavy weight tool set. They are completely helpless when they are confronted with any other database.
Unfortunately, all that misleading rubbish in LibO looks similar to MS Access but without working as in MS Access. Same problem with some Calc features that had been added to LibO 3.4, btw.

Øthe BoD is not interested in investing in that part of users

There is no need to invest too much. Remove all the broken and incomplete GUI tools, keep the connectivity and form controls for the experts. No functionality will be lost.
For the usual mail merge the current query designer is sufficient.
The plain old report wizard (but not the overambitious Report Builder) should be re-enabled for all Writer documents.

The "Advanced-LibO-Base" will fail because:

Øthe Base module as a program is half done (as above) -- can be used
only of that minority of users who have the skill to do their own
programming to get around problems and failures

Again, I hardly use any macros at all in the context of Base. Generally speaking, databases are too abstract for the vast majority of today's computer users who can not deal with generic software tools. They need tools that do exactly what they need right now (they call them "apps" nowadays).

Øwho have the skill to use "real" externaldatabases (e.g. SQL)

Øthe connection LibO-Base óexternal db does not work (if not recently
fixed)

I only work with external databases (HSQLDB and H2) and I know that others use Base with MySQL. Millions of OOo/LibO users use Base with a spreadsheet as external pseudo-database.
Many users don't know that they are using Base because the mail merge wizard hides the fact that it establishes a database connection (to a spreadsheet in most cases).

Øthe BoD is not interested in investing in Base

In not so very far future -- if a total destruction is excluded - our
whole world will be computerized, which means that every household must
have a computer and at least the most necessary programs for
communication (writing, mailing, internet) and calculating and perhaps
databases. Most of these private households have to or will prefer to
use freeware programs instead of commercials provided that the use is
easy, free of any problems and does not require special skills.

Everybody uses databases each and every day online. Whenever you connect to facebook, ebay or youporn you use some database, mostly MySQL. The cloud will do all the nasty work for you in the near future.

The fact that MS is a 95% market leader has to be accepted; MS dictates
the standards and it's products work well enough. The only real
possibility for anyone to compete MSO is a free (low cost) and perfectly
functioning product that gets a total acceptance by the children in
these grass level households.

In the last years I only saw totally incompetent MS Office users struggling with their own endlessly nested hard formatting attributes and working against the ribbon.
Whenever I was forced to co-edit formatted text or spreadsheets with MSO users I was the one who kept a "master copy" and pasting the modified content as plain text into my ODF layouts.
Within our own small business we use 100% ODF simply because I am the one who does the templates. Output goes to the printer or PDF, weird MSO input can be loaded into the free MS readers. I consequently reject all OOXML sent to me personally. I am in a priviledged situation and I make use of it.

The application that these children get used to at home and in school
will cause the real press on commercial programs also in business.

The kids would not learn anything from LibreOffice neither. All I know about office software I learned with MS Office and books about MS Office (the "professional" version with Access included). Non-IT persons do not read books on software although the software has become much more sophisticated.

Considering a possible common aim to compete the commercials, it is a
waste of valuable resources when open source developersoverlap or
compete each others . Cooperate globally?

Who cares? In the upcoming decade of the 20ies this sort of text processing and spreadsheets will cease to exist.

Hi Perrti,

From this long and very interesting thread and some other
discussions on this mailing list too, together with my own recent
experiences, there is only one main conclusion to draw:

There is no real future forLibO's Base module, perhaps not for the
whole LibO suite.

I think you make some interesting points, but are too despondent.

Leaving "the whole suite" aside, I think there is a very real future
for database use here. We have the ability to make it the way we
want it. The converation *does* point to the idea that the future of
this probably needs to be rather different from (at least some of)
the past.

Mark Stanton
One small step for mankind...

One for you.

Much users even don't read the program's help.
A light read over all the help, shows very well what the program can do and how, many samples there, and also can solve the majority of the cuestions on daily use.
To drive a car is needed a license, in other words known the rules. Nobody was born learned.

Miguel Ángel.

OK Andreas (or anyone else) - for those of us not so good at this how about a detailed Tutorial on doing this??

Right here....

Step 1 --------
Step 2 --------
Step 3 --------

etc

(??)

Best regards

IanW

Hi Ian,

The easy version is :-

1) Open your database with the HSQLDB embedded data.
2) In a separate window, create a new database with any other kind of
   data engine.
3) Drag the tables from the embedded database to the new database,
   one by one.
4) Drag any other objects from the old database to the new one, too.

I'm guessing that the important bit that you need there is missed
out, the "how to create and link up to A.N.Other database".

Whilst there are several of those, multiplied by the possible access
methods, and perhaps even the possible operating systems, we ought to
be able to produce the details for each type.

If I'm right about this, then I'll go on to turn out step-by-step's
for those.

Would that be the thing that what make it useful?

Regards
Mark Stanton
One small step for mankind...