Engaging users: initial results of the survey

For me I tried to navigate bugzilla to report continuing bugs where 2 formatting issues occur regularly:

1. Some cells in Calc have mixed size formatting in them or mixed fonts (parts are in Geneva 10 and parts in Geneva 12) I can go in by hand to each cell, select the piece that is the wrong size (12 point) change the font size and save the spreadsheet. At some point in the future (and no it is not consistently the next time) I re-open the file and those corrections are gone, the fonts are back to mixed size. It happens all the time but I can' get a small spreadsheet to demonstrate the problem. The one I am using that has the problem contains 15 years worth of sheep data and records and has a number of separate sheets in it. I've tried to copy out smaller sections and while I can get the small ones to have the mixed font issue when I change the font in them it seems to stay changed.

2. Alternatively I click on the upper left blank cell above the row and column number lines to select the entire spreadsheet. Change the font and or size . Cells with a single font and size in the text change as expected but any cells with mixed sizes do not.

Unfortunately bugzilla is worse than difficult to use and now it's even harder to find out how to do that.

Yet another way to look at it is that the number of volunteers
reporting the bug or making it an issue to tackle over the various
collaborative and communication channels we have around the project.

Eugenie (Oogie) McGuire
Desert Weyr http://www.desertweyr.com/
Paonia, CO USA

You made a survey without a survey statistician on your team. Did you
send out a request for such a person on the mailing lists to advise you
before you put together the survey? Did you have a clear and concise
question that you wanted to answer before you developed the survey
questions? Did you run the questions by an aforementioned professional
in the staff and check for confirmation bias?
I am not a professional statistician, and that's just what I spotted. I
have covered surveys as a journalist in my previous career, though. And
I also am a veteran of setting up business projects. A survey
statistician would have a lot more to say I am sure. And we're not even
starting on the analysis. In fact, I'd throw out the analysis and the
results and start anew. First off, define "users" (end users,
evangelists, business users?) and state the overall purpose of your
survey in a single question.
I regret some of the tone of the previous e-mail (first e-mail prior to
coffee), but there's nothing here to work with. You've got 300
self-selected users with at least two major questions in one survey that
you did not break out by region, sex, profession. You want results, you
need good data underneath.

You made a survey without a survey statistician on your team. Did you
send out a request for such a person on the mailing lists to advise
you before you put together the survey? Did you have a clear and
concise question that you wanted to answer before you developed the
survey questions? Did you run the questions by an aforementioned
professional in the staff and check for confirmation bias?

No. And apparently you have little awareness of how our project works.
But you make a couple of valid points.

I am not a professional statistician, and that's just what I
spotted. I have covered surveys as a journalist in my previous
career, though. And I also am a veteran of setting up business
projects. A survey statistician would have a lot more to say I am
sure. And we're not even starting on the analysis. In fact, I'd
throw out the analysis and the results and start anew. First off,
define "users" (end users, evangelists, business users?) and state
the overall purpose of your survey in a single question.
I regret some of the tone of the previous e-mail (first e-mail prior
to coffee), but there's nothing here to work with. You've got 300
self-selected users with at least two major questions in one survey
that you did not break out by region, sex, profession. You want
results, you need good data underneath.

You know, aside being rather inaccurate, you're welcome to run another
survey. We're always looking for more volunteers. And I'm glad to help
you on this, so please go ahead.

best,

Charles.

Okay, I point out problems and you're response is "you don't like it
you can run out your own survey" and then say I'm inaccurate without
stating why I'm inaccurate with a solicitation for donations in the
previous e-mail. Do you see the major issue here? Flies, honey, vinegar.

I don't know how your project works, but if you're not doing the proper
work beforehand I don't know how it can work. Ask anybody who's run any
successful project. Heck, even the leaders of failed projects can tell
you. They probably have more information.
First, you define your goals. Next you gather and prepare your
resources. You do a test run, maybe more than one and hope you have
enough time. You have people with specific knowledge critique and make
adjustments. Finally you run the project, and afterwards you analyze
and make improvements for the next time. Those principals apply whether
you're running a for profit project or a non profit.
And that would be the bare bones work if I was running a local project.
You're going global, which involves understanding cultural differences
as well. That is not the type of thing I would do with an ad hoc team
with nobody who has any experience in what I was doing in the first place.
Like I said, define the questions, gather the mailing list. And if you
don't have access to anybody with experience in statistics, don't launch
until you do. A badly done survey is worse than none at all.

John,

I'm well aware on how to run a project; and many comments and
critiques I have read so far are valid. Just keep in mind that we're
not going to run just another survey because according to some, it
wasn't granular enough (btw: there are others who would object to your
methodology as being too expensive to organize or as unncessary).
Running the survey again would end up confusing the users who already
answered.

If you seriously would like to get involved, you should - I mean it,
there's no sarcasm.

Best

Charles.

Charles,

  What's expensive about setting up a mailing list dedicated to the
survey and asking internally "what do we want to know about users and
how do we want to find out about it"? Or doing some requests for
volunteers from local university statistic students? Your volunteers
don't necessarily have to start from the community you are surveying
Professionalism is not about cost; it's about preparation. And I
wouldn't recommend another survey. At least, I wouldn't recommend it
yet. If you don't have money, you do have time. Take six months to a
year to get the right elements in place. In the meantime, use less
formal ways to explore what you want to know about users (feedback
forms, mailing lists, etc).

John,

Okay, that sounds different from what I initially understood. :slight_smile:
I thought you wanted to restart the survey. Anyway, thanks for the tip.
We'll take more care about phrasing what we want in the first place
next time. However, I suggest you read the archives of our marketing
list during the month of October to see our discussions.

Best,

Charles.

You didn't provide links to the bugs that you provided, so I really
can't tell if they're crashes every 4th time you start, "I don't like
where the mirror is placed", or something in between problems. And yes
there is a right way to tell the customer that the issue is either not
one that you get to at this moment or that the majority prefer the
solution solved another way (usually it involves a suggestion of an
alternative technique).
But even though you treat the customer as if they are always right, that
does not mean that they are always right. Some things the customer is
wrong on. Some things are out of budget for LO, and some things are
just preferred to be done another way. The choice has been put in your
court. You can use LO or you can find another office suite that meets
your needs depending upon the issue. The best thing about LO is that
you don't have to drop one to take on another. And not even Microsoft
or Adobe would drop everything and start changing code just because one
user wants a change. Any company that did that would soon find itself
bankrupt.

Hi Tanstaafl,

LibreOffice is using freedesktop.org infrastructure for bug
management software and code repository.

Ok, this doesn't help me any, but ok... :wink:

How do I just log into the bug reporting system and search it? Anyone?

This is a list of all LibreOffice bugs
<https://bugs.freedesktop.org/buglist.cgi?query_format=specific&order=relevance+desc&bug_status=open&product=LibreOffice&content=>.

thanks, but I didn't ask for that...

You would eventually discover that when "Getting Involved"...

Nope... clicked that link, still couldn't find a 'Bugzilla Login Page' that I can simply log into (with my user account), then search bugs, check status of or work with bugs I've reported, etc...

Maybe we should rename "Get Help" -> "Bug" to "Report a bug"

That would help for that one issue, but I still don't have a clue how to log into the bug system and work with bugs...

Hi Charles

Tanstaafl wrote

That would help for that one issue, but I still don't have a clue how to
log into the bug system and work with bugs...

You are right that the current documentation won't take you there :slight_smile:

Go to
https://bugs.freedesktop.org/
and click on Log In (second item from the right on the top or bottom menu)

Hope this helps...

CC'ing the website list because it is about the website, but I'm not
subscribed, so please CC me on replies if you really want to discuss this
complaint.

I've also cc'd the QA team (who manage/work on the bugtracker,
including Rob Snelders, the lead dev for the Bug Submission Assistant
("BSA"))

This prompted me to go file a bug (Feature Request) for something I've been
meaning to file for some time now, then I couldn't remember if I'd already
done it before, so I wanted to check and see...
...
The 'new' website is extraordinarily difficult to navigate if you want to do
anything other than download the latest version.

My simple goal was to log into the Bug system, check 'My Bugs' and see if
I'd reported this yet, and if not, report it...

Fair enough. So you were expecting a link to the bugtracker either on
the main page or from the BSA?

(Rob - Thinking a bit broader, it would be nice if we could give users
a single page that would display information about their activity on
Bugzilla, the Ask site, etc. Using some form of SSO like OpenID or at
least shared credentials (e.g. LDAP) could make this easier)

2. After going to the main website, I clicked on 'Get Help', and then
clicked on 'Bug'...

The only option here is to report a bug.

What if I don't want to report a bug, but only want to search for bugs?

Even after I log in, the only next step available is to continue reporting a
bug I don't want/need to report!?

Rob - Any thoughts here?

This is HORRIBLY BROKEN.

How do I just log into the bug reporting system and search it? Anyone?

To log in, navigate to http://bugs.freedesktop.org/ and click on the
"Log In" link. To search the bugs, click on the "Search" link.

I agree that we should make it easier for users to find and use
Bugzilla. Tanstaafl -- we're actually right in the middle of some
backend infrastructure improvements for Bugzilla, but I'll make sure
that we spend some time on the frontend of things as well.

Best,
--R

Hi :slight_smile:
Something that often annoys me is that we seem to ignore all the work
of all the devs who are paid to work on LibreOffice.

I thought something like 10%-20% of devs are employed by various
companies, governments and other organisations? The advantage for the
organisations, companies and governments is that they still get the
suite far cheaper than they would pay in license fees PLUS they get to
choose what bugs their own devs focus on.

If you don't pay a dev then you still get to use a fantastic office
suite for free and a fairly tiny donation goes a loooong way to
improving it further. Of course we can grumble but i think it's
important to sit back and appreciate just what we do get too.

if we worked harder to encourage more companies to use LO and helped
them find ways to employ part-time or full-time devs with the savings
they would make on license fees then it might start to "snowball" even
more quickly.
Regards from
Tom :slight_smile:

Hi Tanstaafl,

LibreOffice is using freedesktop.org infrastructure for bug management
software and code repository.

How do I just log into the bug reporting system and search it? Anyone?

This is a list of all LibreOffice
bugs<https://bugs.freedesktop.org/buglist.cgi?query_format=specific&order=relevance+desc&bug_status=open&product=LibreOffice&content=>
.
You would eventually discover that when "Getting
Involved"<https://www.libreoffice.org/get-involved/>
.

Maybe we should rename "Get Help" -> "Bug" to "Report a bug"

HTH,
Philipp

Hi, Michael,

Hi Ken,

After using LO for awhile, I found and filed a couple of bugs/issues. I
wanted to contribute in the area of reporting issues, but I don't have
the knowledge to fix them. I didn't expect those problems to go to the
head of the line. But I *did* expect them to be put in the queue and
eventually fixed.

  The problem of course is that there is no queue of bugs-to-fix. We try
to prioritize issues, so that we can see those that are seriously
debilitating and then try to fix those on a best-effort basis.

Maybe there should be a queue, and fixed on a FIFO basis. Are either of my posted bugs, or the ones that I listed in another post debilitating? No. Would I expect mine to be fixed before X number of debilitating bugs? Not in a million years. But they need to be fixed eventually, and not languish until the end of time. LOL

More than once, it's mentioned that open source projects have limited resources. That I don't mind, either. But, if you can't/won't/don't get all of the bugs squashed with the resources you have, then you need to step back and reassess the situation. You need to do 1 of 2 things:

  1. Acquire more resources
  2. Acknowledge the project has outgrown the existing resources, and it's time
    to top adding features you do not have the resources to maintain.

As I said earlier, it's better to do a few things well, than a lot of things poorly. I seriously doubt there are thousands of people with the same issues (bugs) I have. But there must be a lot of people like me for whom a feature they need doesn't work. Individually, there won't be many users per bug. But in the aggregate, you could have thousands and thousands of unhappy users. Do you feel those folks are going to give LO a good push with out adding the proverbial "but"?

What I didn't like was being told my issues were not important. BS!
It's important to me.

  This is the interesting piece to me. Can you expand on your experience
there ? clearly all bugs are important to someone - but not all are
'Critical' or whatever from a prioritization perspective. Nevertheless,
perhaps the naming of those prioritization is needlessly offensive.
Potentially with our new bugzilla we could use P1 -> P6 or whatever -
making it clear that this is a spectrum.

This is were the word "critical" is the issue, and how it's defined. Sometimes, you can give the word a fixed, quantitative "value", if you will in some cases, in others, it's subjective. An issue may be minor and not critical from your perspective, but it could be major and very critical to your user.

What told me I was being ignored, and essentially my issues were not critical, is the fact they were never assigned to anyone for fixing, and labeled as such.

Let's say you have a car, and every 4th time you go to use it, it won't
start. You take it to your mechanic, and each time you do, he tells you
"it's not important, he's got bigger problems to solve". Are you going
to continue to take it to that mechanic, or are you going to find a
different mechanic?

  I'm really not sure that there are any mechanics out there that do work
for free; I've not met one. Of course - if you want to pay for a bug to
be fixed, our level-3 bug queue has only a handful of open-bugs, and
they turn over on a weekly basis. But I strongly suspect you don't want
to pay.

Don't want to pay? I bought a commercial writing program to help replace LO. Isn't that paying? <G>

  So - perhaps a more apt analogy is taking your car to a local friendly
volunteer / free mechanic down the road who helps people out of the
goodness of their heart - and berating them for not spending a week
investigating and fixing the squeak in your suspension -now- because
he's been working trying to get other people's car's to start at all :wink:

With the car analogy, it depends on how "critical" having the car working is to you. If you need to have it start every time, barring being out of gas and such (LOL), you pay to get it fixed. If the use is sporadic, and dependability of that car isn't needed, you might choose to have your neighbor tinker with it. Even then, there's an end to that path, you get your car back, and do something different. Sell it, give it away, let it rust away in your driveway.

Either way, the car eventually gets used less and less.

  Anyhow - there is no desire to offend people through the prioritization
flow; that is a really critically useful function of QA though - so
ideas on how we can improve that appreciated.

I downloaded another open source writing program, and the developers are clear they do what they want, if you want an issue fixed, you fix it yourself, one way or another. That's fine, if there's issues I need and they don't work, that's fine. They aren't telling me to use their program instead of XXXXXX. They say here it is, if it works fine, if it doesn't, please use something else.

The minute LO or any open source program says "Use us instead of XXXXXXX or YYYYYYYY", you just crossed a line where users will expect things to work. After all, you just told them you can use LO instead of XXXXXX or YYYYYYY. But in XXXXXXXX or YYYYYYY, the feature(s) the user is looking for works and in LO it is broken, and the user does not have the ability to fix it, what do you think the user is going to do?

I think there's a dangerous perception here: The perception that the LO
developers work on nothing except what they want to work on.

I'm pretty sure that that is very false. They work on LO because they
want to work on LO, and they probably choose what to work on based on
at least the following:

a) How many people report a specific bug
b) How serious that bug is to people's productivity
c) How in line that bug is with current roadmaps
d) Regression bugs probably have higher priority
e) What parts of the system they know the best
f) How much time they have at the moment, and how big the bug is
g) How much fun they think it will be (or more likely, which bug will
be the least annoying to fix)

The logic that "a bug is not important because not many people report
it" has a big flaw: most people give up without bothering to
report... (and in the case of Bugzilla, reporting requires quite a
lot of effort)

This logic may not be true in an absolute sense, but consider that it's
not normally a question of how important the bug is on its own merits,
but how important the bug is compared to other bugs. If 50 people have
reported bug A and only 2 people have reported bug B, while bug B may
still be important, and there may be another 20 people who haven't
reported it, it is not as important as bug A, and there may be another
20 people who haven't reported bug A as well.

Here's the fault with this logic.

I'm going to up the number of people for bug B just for illustrating my point.

50 people have issues with bug A. 5 people have issues with bug B. Extrapolate... 5 people with bug C, 5 with D, all the way though Z. You now have 125 people unhappy with 25 bugs.

If the goal is to increase the usage of LO, is it better to have 50 unhappy people over A not being fixed, or 125 unhappy people over bugs C-Z. Which group is more likely to pass along negative impressions?

You also have to ask if bugs B-Z are "bugs" or feature requests.

After using LO for awhile, I found and filed a couple of bugs/issues. I
wanted to contribute in the area of reporting issues, but I don't have
the knowledge to fix them. I didn't expect those problems to go to the
head of the line. But I *did* expect them to be put in the queue and
eventually fixed.

What I didn't like was being told my issues were not important. BS!
It's important to me.

Let's say you have a car, and every 4th time you go to use it, it won't
start. You take it to your mechanic, and each time you do, he tells you
"it's not important, he's got bigger problems to solve". Are you going
to continue to take it to that mechanic, or are you going to find a
different mechanic?

You didn't provide links to the bugs that you provided, so I really
can't tell if they're crashes every 4th time you start, "I don't like
where the mirror is placed", or something in between problems.

It never occurred to me someone would want the bug numbers. <G>

  1. 44871
  2. 44986
  

And yes
there is a right way to tell the customer that the issue is either not
one that you get to at this moment or that the majority prefer the
solution solved another way (usually it involves a suggestion of an
alternative technique).
But even though you treat the customer as if they are always right, that
does not mean that they are always right. Some things the customer is
wrong on.

Indeed, sometimes they are wrong. But, if you want them to return, they are always right. :slight_smile:

Some things are out of budget for LO, and some things are
just preferred to be done another way. The choice has been put in your
court. You can use LO or you can find another office suite that meets
your needs depending upon the issue.

As I've posted, I am looking for an alternative, and have "candidates". LOL

The best thing about LO is that
you don't have to drop one to take on another. And not even Microsoft
or Adobe would drop everything and start changing code just because one
user wants a change.

Changes are one animal, fixes are another.

Sometimes (often?) a fix entails a change...

You also now have 25 bugs to fix, which is probably going to take
*considerably* longer than just fixing bug A.

And you're forgetting about bugs/feature requests AA through ZZ, so
yes, this analogy will fall down at some point.

Again, the developers have limited resources to fix bugs, which
includes time and knowledge of the specific parts of the system, and
they have a lot of bugs and feature requests to get through. Either way
they slice it, someone is going to be unhappy. So they do the best they
can, and I'm sure that best involves a lot of discussion and decision
making, with a much better understanding of the tradeoffs than we have.

What told me I was being ignored, and essentially my issues were not
critical, is the fact they were never assigned to anyone for fixing,
and labeled as such.

So you're upset because your issues were not considered "critical"?

Don't want to pay? I bought a commercial writing program to help
replace LO. Isn't that paying? <G>

Well, then as pointed out, you could simply have put that money towards
having a developer prioritise your issues. What's the problem here?

The minute LO or any open source program says "Use us instead of
XXXXXXX or YYYYYYYY"

And when exactly have they said this? I mean, I for sure advocate using
LO instead of MSO, but I'm not sure this is an official party line.

With LO quite some effort is made to give users the best experience, and
to give them some choices around that, but it just can't fit everybody's
needs. If it doesn't fit yours, you are free to go elsewhere. As you
have said you are doing. As that other software you spoke of says. So
how is it ok for the other software to basically say "here you go, if
it's broke, don't bother us, we don't care", but it's not ok for LO to
say "here you go, if it's broke, we'll do our best to fix it, but
please bear in mind that we can't fix everything"? It just keeps
sounding like you have a double standard.

As far as I can see, you're upset because you think your bugs (well, the
ones you reported) are important enough that they should be critical,
but the developers don't agree, and you're upset because after a couple
of years the bugs are still in the queue, not assigned yet. I just
can't see that as a heinous crime. For some projects the lack of action
speaks of a disregard of the users, sure, but here there is plenty of
action on bugs, just not on those bugs. That doesn't speak of a
disregard of the users, it speaks of those particular bugs not being
valued highly by the developers. Perhaps that is wrong of them, sure,
and perhaps those bugs should be bumped a little to get some action on
them, but perhaps they just haven't had enough users reporting those
issues for anyone to notice next to the flood of other issues that are
being dealt with daily. I haven't looked at your specific bug reports,
so I really don't know.

I'm just trying to see why you are so upset about this, when it clearly
doesn't seem reasonable to me. Is it because it has happened to a string
of bugs, and you feel like there is a pattern of ignoring the bugs you
submit, and have generalised that to mean there is a pattern of
ignoring all users bugs? Is it because you feel your particular issues
really are *that* critical that the developers should have sat up and
taken notice by now? Is it because you feel you were given false
expectations of LO that haven't been lived up to?

Paul