Base record access unacceptably slow

Am just about to make the switch - will let you know asap! I'm very hopeful. And I've decided to switch to sqlite when I'm not so rushed. Have heard that that's where LO's going anyway.

Tom

, On 07/28/2011 12:53 AM, Tom Cloyd wrote:

That command appears to have cut 5 seconds off the record pointer move
test, and also off the full db search test I ran previously.

Well better than nothing I suppose, but I do sympathise. Did the JDK/JRE
change suggested by someone else help any further ?

Alex

Am just about to make the switch - will let you know asap! I'm very hopeful. And I've decided to switch to sqlite when I'm not so rushed. Have heard that that's where LO's going anyway.

Tom

Ug. This is getting ugly really fast. I'm really not on home ground here at all.

After 15 minutes of trying to make sense of what I found at
http://archive.canonical.com/ubuntu/pool/partner/s/sun-java6/, I downloaded
sun-java6-bin_6.22-0ubuntu1~10.04_i386.deb and

sun-java6-jre_6.22-0ubuntu1~10.04_all.deb, following the thread at http://www.oooforum.org/forum/viewtopic.phtml?t=125253&postdays=0&postorder=asc&start=0.

Then I did this at a console, with the following result:

tomc@LDT:~/software_archive$ sudo dpkg --unpack sun-java6-bin_6.22-0ubuntu1~10.04_i386.deb
[sudo] password for tomc:
dpkg: warning: parsing file '/var/lib/dpkg/status' near line 38010 package 'amaya':
error in Version string 'wx-11.3.1-1': version number does not start with digit
dpkg: warning: parsing file '/var/lib/dpkg/available' near line 40706 package 'amaya':
error in Version string 'wx-11.3.1-1': version number does not start with digit
dpkg: warning: downgrading sun-java6-bin from 6.26-1natty1 to 6.22-0ubuntu1~10.04.
(Reading database ... 190655 files and directories currently installed.)
Preparing to replace sun-java6-bin 6.26-1natty1 (using sun-java6-bin_6.22-0ubuntu1~10.04_i386.deb) ...
debconf: unable to initialize frontend: Dialog
debconf: (Dialog frontend requires a screen at least 13 lines tall and 31 columns wide.)
debconf: falling back to frontend: Readline
sun-dlj-v1-1 license has already been accepted
Unpacking replacement sun-java6-bin ...
Processing triggers for desktop-file-utils ...
Processing triggers for menu ...
dpkg-query: warning: parsing file '/var/lib/dpkg/status' near line 38010 package 'amaya':
error in Version string 'wx-11.3.1-1': version number does not start with digit

Most of this is just garble to me,

THIS is scary: "dpkg: warning: downgrading sun-java6-bin from 6.26-1natty1 to 6.22-0ubuntu1~10.04."
I said UNPACK, not INSTALL. What's this "downgrading" nonsense? Then this: "Preparing to replace sun-java6-bin 6.26-1natty1" Huh? All this on an "unpack". This is beyond scary. This is nuts. What's up with this???

Then, and this is the main problem - where's the result of the command? I expected the unpack to put files in a dir, in the same dir as the DEB file. Isn't this usually what happens when one unpacks a file? But there's nothing there.

I'm in freefall right now. Don't know what just happened, don't know what to do next. Can anyone help?

Guess I'm not going to get any db work done tonight, after all. Not a good day.

Tom

Am 28.07.2011 08:15, Heinrich Stoellinger wrote:

I am not giving up hope yet for LO 3.4.2 - especially since it targets
business...
Isn't there a OpenSource fork of MySQL called MariaDB?!?
Regards
H

Dear Heinrich,

Face it: There is not a single LO developer doing anything Base related. The Base component will fall apart sooner or later. Writer's mail merge and bibliography will be spreadsheets, form controls will be mere gimmicks and nobody except you and me and some hundreds of professionals will notice the severe loss.

Grüße aus NRW,
Andreas

________________________________
From: Tom Cloyd <tc@tomcloyd.com>
To: users@global.libreoffice.org
Sent: Thu, 28 July, 2011 9:04:22
Subject: Re: [libreoffice-users] Re: Base record access unacceptably slow

, On 07/28/2011 12:53 AM, Tom Cloyd wrote:

On 07/28/2011 12:44 AM, Alexander Thurgood wrote:

Le 27/07/11 18:14, Tom Cloyd a écrit :

That command appears to have cut 5 seconds off the record pointer move
test, and also off the full db search test I ran previously.

Well better than nothing I suppose, but I do sympathise. Did the JDK/JRE
change suggested by someone else help any further ?

Alex

Am just about to make the switch - will let you know asap! I'm very hopeful.
And I've decided to switch to sqlite when I'm not so rushed. Have heard that
that's where LO's going anyway.

Tom

Ug. This is getting ugly really fast. I'm really not on home ground here at
all.

After 15 minutes of trying to make sense of what I found at
http://archive.canonical.com/ubuntu/pool/partner/s/sun-java6/, I downloaded
sun-java6-bin_6.22-0ubuntu1~10.04_i386.deb and

sun-java6-jre_6.22-0ubuntu1~10.04_all.deb, following the thread at
http://www.oooforum.org/forum/viewtopic.phtml?t=125253&postdays=0&postorder=asc&start=0
<http://www.oooforum.org/forum/viewtopic.phtml?t=125253&postdays=0&postorder=asc&start=0>.
.

Then I did this at a console, with the following result:

tomc@LDT:~/software_archive$ sudo dpkg --unpack
sun-java6-bin_6.22-0ubuntu1~10.04_i386.deb
[sudo] password for tomc:
dpkg: warning: parsing file '/var/lib/dpkg/status' near line 38010 package
'amaya':
error in Version string 'wx-11.3.1-1': version number does not start with digit
dpkg: warning: parsing file '/var/lib/dpkg/available' near line 40706 package
'amaya':
error in Version string 'wx-11.3.1-1': version number does not start with digit
dpkg: warning: downgrading sun-java6-bin from 6.26-1natty1 to
6.22-0ubuntu1~10.04.
(Reading database ... 190655 files and directories currently installed.)
Preparing to replace sun-java6-bin 6.26-1natty1 (using
sun-java6-bin_6.22-0ubuntu1~10.04_i386.deb) ...
debconf: unable to initialize frontend: Dialog
debconf: (Dialog frontend requires a screen at least 13 lines tall and 31
columns wide.)
debconf: falling back to frontend: Readline
sun-dlj-v1-1 license has already been accepted
Unpacking replacement sun-java6-bin ...
Processing triggers for desktop-file-utils ...
Processing triggers for menu ...
dpkg-query: warning: parsing file '/var/lib/dpkg/status' near line 38010 package
'amaya':
error in Version string 'wx-11.3.1-1': version number does not start with digit

Most of this is just garble to me,

THIS is scary: "dpkg: warning: downgrading sun-java6-bin from 6.26-1natty1 to
6.22-0ubuntu1~10.04."
I said UNPACK, not INSTALL. What's this "downgrading" nonsense? Then this:
"Preparing to replace sun-java6-bin 6.26-1natty1" Huh? All this on an "unpack".
This is beyond scary. This is nuts. What's up with this???

Then, and this is the main problem - where's the result of the command? I
expected the unpack to put files in a dir, in the same dir as the DEB file.
Isn't this usually what happens when one unpacks a file? But there's nothing
there.

I'm in freefall right now. Don't know what just happened, don't know what to do
next. Can anyone help?

Guess I'm not going to get any db work done tonight, after all. Not a good day.

Tom

Hi
Don't worry about downgrading a package. It's easy to upgrade again if you need
to do that later. Sometimes packages suffer from regressions making it
important to downgrade. Wine has often suffered from this.
Regards from
Tom :slight_smile:

Hallo Andreas,
In my view, BASE "falling apart" would mean LO's "death sentence" in the long
run! Anybody in even the simplest business environment will want to write
documents based on data stored in business-critical databases (and I think I
am right in assumung that relational DBs have been the standard now for decades!).
Does anybody REALLY think that a package like LO can survive if it ignores
such an important sector of users? I sure don't!!!
Gruesse aus Salzburg
Heinz

Hi :slight_smile:
Good call. Wikipedia gave this
http://en.wikipedia.org/wiki/MariaDB
and their homepage
http://mariadb.org/

Perhaps we could try to get some help from their devs. They might have soem
good ideas on how Base needs to be developed.
Regards from
Tom :slight_smile:

Hi again :slight_smile:
As well as MariaDb there is also Drizzle which is supported by many of TDF's
supporters
http://en.wikipedia.org/wiki/Drizzle_(database_server)
and their homepage
http://drizzle.org/
Regards again from
that other Tom :wink:

Am 28.07.2011 10:04, Tom Cloyd wrote:

I'm in freefall right now. Don't know what just happened, don't know
what to do next. Can anyone help?

Guess I'm not going to get any db work done tonight, after all. Not a
good day.

Tom

I used my graphical zip tool to extract the data.tar.gz from the 2 package files.

Hello Tom,
That's fine. However, to use such a DB-backend one also needs support in a
myriad of other software in a webserver (mail, PHP-frameworks, etc., etc.).
Regards
H. S.

Hi Tom,

When the first problems showed up for me about 6 months ago, it was recommended to go back to the Java 1.6.0.22 from 1.6.0.24. I have my database on 4 computers, and could never make things work with getting a previous version installed, so I gave up and just tolerated the situation. Also, I had security concerns going backwards since, as I understand it, among other things updated Java versions have have security issues fixed. I'm relatively good with Ubuntu, but far from an expert. What we all know is that Java is the problem. Can someone give us instructions on how to use the LibreOffice front end with a database that doesn't require Java. I see that you had said that LibreOffice may be moving to sqlite? Is that a solution that anyone could help us with?

Don

Heinz,

I completely agree. LO without a function Base won't fly. Either TDF recognizes this - by DOING something - or we have our answer.

Tom

Hi Don,
In my view LO/OO do NOT require Java, neither on Linux nor on Windows.
As I posted earlier, I have been using ODBC for both the Windows and
Linux versions. It works o.k., even though I still hope that the native
MySQL-supplied connector will function correctly under 3.4.2.
Regards
H

Don,

Seems like a reasonable request to me, and I'll up the ante.

Where the &^%$ is the management - The Document Foundation - in all this, right now, today? Do they even watch this list? In short, do they give a damn that the only theoretically viable alternative to Access (for ordinary users) is in real trouble? Why aren't they showing up here with some clarifying position statement?

I'm desperate for time, a fix, and vision of a long-term solution to this mess. I have work to do today, a lot of it, and I can't do it. I can't solve the problem, and other than by implementing the regress-your-java solution idea (which I have yet to be successful with). No one else is solving it, either. For some, migrating to another backend is not a challenge. For the rest of us, it's unknown territory. I researched this a bit, and while there certainly IS stuff out there about how to do it, there's not a lot, and there are multiple levels of challenge with this solution anyway.

Personally, I'm definitely up for taking this on (what option do I really have?), but do we really have to straggle through the mountains one by one, eventually meeting on the other side, those who make it, to talk about the experience?

So, I propose two things:

1. Anyone who has TDF connections - please get on the phone and update them. The question is this, I think: how important, going forward, is Base, to them? If they are going to support it, today would be a very good day to do it. If not, yank the code, stop telling people they have a db component in LO, and start getting honest.

2. If LO's in trouble with the current sun-Java, so's OO. Where's Apache in this situation? Again, where's *TDF*? Why aren't they and Apache working together on this? Looks rather like a leadership problem, to me.

2. On the assumption that those of use who need a working db are going to have to find the way home ourselves (as I said, I need to get work done TODAY, and I'm not kidding) -

a. Can someone more Linux-clever than I lay out clearly the steps involve in implementing the solution found at the end of this thread - http://www.oooforum.org/forum/viewtopic.phtml?t=125253&postdays=0&postorder=asc&start=0. As I pointed on in another post last night, I tried it and simply got in over my head. This is a decent short-term solution.

b. Can we work together to lay out the steps to set up an alternative back end? I'm going to start on sqlite, Others may wish to work on a different db engine. Then let's get the procedure out where it can be seen and used by others.

c. Let's get altruistic about the poor bloke who, this morning, is about to set up a Base db using a java-run backend: Could someone put a notice in the documentation updating people about the current situation? It's not right for us to keep this information only on this list.

Now I'm off to fully regress my java (I don't see a problem with this), while I work on getting sqlite and Base to play together.

Tom

Hi :slight_smile:
I agree too but i think we have to agitate to get something done. So far the
only response i got was an unhelpful RMS quote. I have a Gandhi one "First
they ignore you, then they laugh at you, then they fight you, then you win.".
Which means we have all 4 steps to work through but since some fairly major
companies would benefit it might be possible to get through most of those steps
quite fast.

Could TDF join
http://montyprogram.com/commercial/
Would that help?

TDF is not the type of organisation where we wait to see what "they" do. It's
up to us to work out what we need and from who and go get it.
Regards from
Tom :slight_smile:

Has anybody suggested that this command should an option when saving when ever records are deleted?

Hi,

Different ones of us have tried this. It is a Java issue. I keep my database compacted on a regular basis. Thank you for trying to be of assistance.

Don

Tom Cloyd wrote:

< much clipped to save space >

2. If LO's in trouble with the current sun-Java, so's OO. Where's Apache
in this situation? Again, where's *TDF*? Why aren't they and Apache
working together on this? Looks rather like a leadership problem, to me.

Tom, the other points I can not speak to but Apache does not have the code to work with yet. There are people working on getting it so that work can get started. Base is one of the problem areas that I plan to help work on, maybe a move to another DB engine is the answer.

As side note: There are sections on the two forums for base tutorials.

[1] http://user.services.openoffice.org/en/forum/viewforum.php?f=83
[2] http://www.oooforum.org/forum/viewforum.phtml?f=10

I am no expert on Base so can not say how much the links will help but hopefully they will help some.

Andy

Hi,

In my view LO/OO do NOT require Java, neither on Linux nor on Windows.

AFAIK, LO/OOo currently *DO* require Java for Base to simply work. TDF have announced they would get rid of the java-isms in the code. This implies a major rewrite of Base, though.

Hi Tom,

Thank you for your great ideas and suggestions.

Starting with Java 1.6.0_24, this problem arose with both OpenOffice Base and LibreOffice Base. The problems were documented on an OpenOffice forum that I searched when the problem first arose. Another alternative would be for LibreOffice to have its own embedded version of Java that works instead of using the system Java. One person a month or so ago posted here as to the exact reason the issue has happened. He felt the problem would be corrected when Java was again updated. I was greatly disappointed when 1.6.0_26 came out and the issue was still here. My data base has about 2500 entries with complete contact information, and then a separate text area I use to keep a running record of my contacts with each person. Before Java 1.6.0_24 going from the first record to last last record was almost instantaneous. Now if is painful. I wait patiently for the 20 to 25 seconds for it to happen on my fastest computer, a quad core AMD 910 with 8 gigs of ram. It is slower on my other ones. Then paging backwards through the database, I can click 5 records and each one appears instantly, then before the 6th record there is a pause. This happens consistently. 5 records, pause, 5 records, pause. I need a database. I need one that works proficiently in Linux. I was so glad when Base was added to OpenOffice. I used it for years without issue until about 6 months ago.

Don

I'm up for it! (Love that quote!)

Maybe leaking this issue to the press would get some attention??

Tom C.