LibreOffice QA: Halloween Bug Hunting, and so much more!

LibreOffice QA has been busy during the last few months!

We just had our first BugHunting Session for the upcoming LibreOffice 5.1 release over the Halloween weekend. Testing our alpha1 builds, members of the QA Team helped to lead users, developers, and other community members in identifying and documenting problems in our very first binaries available for this release series. Having support from members of QA, L10n, Developers, members of the Design community, and regular LibreOffice users was a great sign for continued cross-team participation. We’re looking forward to seeing a similar mix of contributors during our next BugHunting Session in December.

We identified 104 bugs during the Halloween BugHunting session, primarily from initial testing with the alpha1. Of the 74 of bugs remaining open, 80% have been triaged to previous versions, leaving only 15 bugs tied to LibreOffice 5.1. Looking at all 5.1 versions, there are only 212 open bugs pegged to this release series, with only 44 open bugs pegged against 5.1 alpha1.

We’ve been busy with regression-hunting, performing over 550 bibisects this year, and over 200 since June. With one of our chief regression hunters and bibisect sorcerer Matthew Francis taking a well-earned respite from the cauldron of crafting new bibisect repositories and hacking on Python internals, we’re actively recruiting new QA members to help perform these binary searches on all platforms.

In fact, with so many of our developers (and other community members) using Free Software operating systems on their workstations, there’s always a need for contributors who are running MS-Windows or OS X to help us track down OS-specific bugs. This includes not only performing bibisects, but also debugging and getting a backtrace for a crashing bug.

Keeping our UNCONFIRMED bug count steady has been challenging. Currently hovering in the mid-500s, other important QA tasks and processes have commanded our time, and we could benefit from several more QA Team members to help shoulder the daily influx of new, untriaged bug reports. With the focus of our regular BugHunting Sessions on finding and identifying new issues in our upcoming builds, we may find it useful to host similar events that focus wholly on triage and “gardening” of the mass of existing reports in Bugzilla. Maybe we could have something like “Clean Sweep Mondays,” where we tackle the existing clutter for a set period of time, and post some quick stats such as total drop in UNCONFIRMED, # of NEEDINFO cleaned up, etc.

Work continues on our comprehensive Media Support wiki pages, a collection of tests designed to directly verify the level of support for various image, audio, video, (and other) file formats across all of our platforms. Keeping these pages up to date ensures that they continue to be a resource for QA bug triaging as well as for our volunteers helping to answer questions on the Ask LibreOffice site. Lead by QA Team member raal, we now have initial image test results for Android, and are interested in talking with developers who’d like to expand the Android Viewer’s capabilities in this area, as well as testers who would like to expand our battery of test results for the Android OS.

Coming up during the first weekend in December, we’re holding our BugHunting Session for the 5.1 Beta1 build. For those of you who are interested in kicking the tires and working with a still-rough-around-the-edges piece of software, your help is greatly appreciated. With a large package such as LibreOffice, it’s invaluable to have the technical members of our userbase exercise some of the more esoteric features of LibreOffice, and identify any minor regressions or usability concerns early-on in the release process.

The QA Team looks forward to seeing you in IRC anytime, or stopping by one of our weekly Wednesday meetings. We’re always happy to answer your questions about bug reports, bibisecting, etc., and to helping new contributors get started with the LibreOffice community!

Advertisements

LibreOffice QA: Over 1000 Bibisects Served!

Nearly every day of the year, members of the LibreOffice QA Team triage incoming bugs, offer support and advice on IRC, highlight and discuss important bug reports, and deal with the behind-the-scenes minutiae required to keep our bug tracker running smoothly and efficiently.

Since 2012, one of the most powerful weapons in our QA arsenal has been bibisect, a git-based regression-hunting tool that vastly simplifies and speeds up the task of identifying when and where problems have been introduced into the code. Our bibisect repositories cover different time periods in our codebase, allowing us to trace both recently introduced issues as well as long-standing bugs.

Tools such as bibisect, as well as excellent cooperation and collaboration between teams within the LibreOffice community, allow us to keep the growth of our regressions low, and the graph of regressions very flat:

regressions-for-bibisect-postWith use of our bibisect repositories growing since 2012, we finally reached our 1000th bibisect. I’m happy to announce that contributor Terrence Enger performed our 1000th bibisect, helping us to identify an issue in how we format comments in Writer. A big thanks to Terrence (who performed not only the 1000th, but also the 1001st bibisect), and as well to everyone on the QA Team who is using our bibisect repositories to help us identify regressions!

If you’re interested in learning more about bibisect, please take a look at Matthew Francis’ excellent talk from the 2015 LibreOffice Annual Conference. It’s a great introduction to the fundamentals of how bibisecting works (e.g. “What is bisection?”), as well as nuances about how we triage bugs and format them so that they may be fixed as quickly and easily as possible:

matthew-francis-bibisect-talk_aarhus_img7If you’re interested in rolling up your sleeves and graduating from spectator to contributor, the LibreOffice QA Team would be more than happy to welcome you into the fold and help you take your first steps in contributing. Find us on IRC at #libreoffice-qa on Freenode or drop an email on the QA Mailing List. Perhaps you’ll be the one to perform our 2000th bibisection!

LibreOffice QA: So much accomplished so far this year!

Many of you are familiar with LibreOffice or one of its predecessors (StarOffice, OpenOffice.org, etc..), but you may not be aware of the immense amount of work that goes into the production of the software and the careful testing of each release. Although there are many different teams within the LibreOffice community who each perform essential roles in the collaborative development process, I don’t have enough space to cover them all today, so I’ll focus on the LibreOffice QA Team, a group of volunteers and employees of various companies around the world who work tirelessly to identify issues with LibreOffice on all platforms, including issues of interoperability, process, accessibility, and ease of use.

The QA Team has accomplished much in the first quarter of this year, including significant reduction of UNCONFIRMED bug count, broad testing of our support for media on all major platforms, migration of our Bugzilla bug tracker to our own infrastructure, information and advice for our Annual Report, exhaustive work testing our LibreOffice Android port, and major improvements with our bibisect repositories. I’m sure I’ve omitted something from that list, but the sentence was getting long enough that I figured I should stop before I ran out of breath 😉

Continue reading

Who doesn’t love Free Software?

walrus-valentines-day_i-heart-free-softwareI Love Free Software Day 2015 is landing upon us like a giant walrus in just 2 days, so I hope my vast and extensive blog readership is ready to celebrate.

The Free Software Foundation Europe (FSFE) has organized this holiday to encourage people to send some love back to all of the people who develop, test, design, translate, and document the Free Software that makes our digital lives possible. There are many ways to celebrate the day, including sending e-mail or snail-mail to the people or projects that you can’t live without, taking photos of yourself with the Free Software that you use (be creative!), or just giving a donation to one or more projects.

As all 4 of you readers undoubtedly know, I spend much of my time working on the marvelous Free Software office suite, LibreOffice, as well as promoting the use of LibreOffice, other Free Software, and free/open file formats in the US and abroad. If you feel so inclined to toss gold, bitcoin, valuable cats, or other forms of currency at LibreOffice, you may do so on this page. If you wish to contribute directly to the project (which takes more time, but is often more satisfying!), just point your navigator of the high seas Internet to our ‘Get Involved’ page.

Of course, there are many other Free Software projects that need your kind care and love (monetary or otherwise). The picture at the top of the page I made in Inkscape using several images from Open Clip Art. (Credits: bow and arrow, wings, heart, and Free Software developer)

So get out there this Saturday and let people know that you’re grateful for the work that they do that makes our whole community possible. Getting positive feedback will make their day!

P.S. All you Free Software hackers/contributors out there, listen up! I know that we tend to get laser-focused on our work and forget about vaguely important things such as our {girl|boy}friends, spouses, etc.., so this is the perfect opportunity for you to send a postcard to those important people to let them know that there are things more important than computers, even if it doesn’t seem that way 364 days out of the year 😉

Mark your calendars: LibreOffice Bugzilla Migration is 1 month away!

tdf-walrus_experiment-iconWhat did you hope to get this Christmas? A new sled? A new laptop? Free Software that can fill out PDF forms?[1]

The LibreOffice QA Team has been hoping to migrate our bugtracker to our own infrastructure for the past year, and after a bunch of testing and experimenting, this January our wish is coming true!

On January 24th, 2015, The Document Foundation will commence migration of our bugtracker from Freedesktop.org infrastructure to TDF-hosted machines. Migration will give us increased flexibility to extend and modify the underlying Bugzilla code to match our needs, integrate other TDF services with the bug tracker, and provide more granular services for projects such as the Impress Remote and the Document Liberation Project.

Continue reading

Happy New Year, LibreOffice!

happy-holidays-libreofficeAs 2014 draws to a close, I’m reminded of all of the amazing things that have happened in the LibreOffice project over the last 12 months. We’ve talked to hundreds of users and supporters at FOSDEM, SCALE, OSCON, FOSSETCON, and other conferences around the world, we’ve hosted Hackfests, LibreFests, and other community events, and we’ve worked on the nitty-gritty of the project, triaging over 8700 bugs and making more than 25000 commits[1].

LibreOffice wouldn’t be possible without the contributions of people working in many different countries and in many different roles. Since I’ve joined The Document Foundation as a QA Engineer this past summer, I’ve had an opportunity to work with new developers, users, technical support staff, teachers, administrators, and volunteers. Each day brings new puzzles and new opportunities to learn, as well as new volunteers and curious users who decide to stick around and help the community after we’ve worked to answer their questions or reproduce and fix their bugs.

The QA Team has been especially busy in the last few months, bibisecting regressions and chopping our UNCONFIRMED bug count in half, dropping under 400 in the last week.  We’re getting ready to migrate to our own instance of Bugzilla at the end of January, which will give us increased flexibility and easier customization of our bug tracker. In honor of Bugzilla, the stegosaurus at the top of the page is doing his best impression of the Mozilla Dinosaur. I’ll make a separate post with all kinds of details about the migration very soon Read all about the Bugzilla Migration right here!

Thanks for the amazing 2014, LibreOffice! I’m excited to see what we can accomplish together in the coming 365 days!

-Q

Join LibreOffice in Seattle for a Bug Triaging Bee & Hackfest!

Who makes the best office suite? You do!

SeattleLibreFest_2014At the tail end of October, LibreOffice is headed to Seattle, WA for SeaGL, “a grassroots technical conference dedicated to spreading awareness and knowledge about the GNU/Linux community and free/libre/open-source software/hardware.” While we’re hanging out in Washington, we’re planning to have a LibreFest — a community event to bring users, developers, and contributors from the Seattle area together to help LibreOffice by squashing bugs, writing code, and increasing public awareness of this amazing Free Software office suite. The LibreFest will take place on Sunday, October 26th at the University of Washington in Seattle.

At the LibreFest, we’re planning to have two tracks available:

  • A Bug Triaging BeeA fun, community exercise for people of all experience levels, from newcomers to experienced QA Engineers
  • A HackfestFor developers and programmers interested in eliminating bugs and implementing new features

Testing bugs and writing code takes a lot of concentration, so we’ll have plenty of free food and drink available to keep you fueled up and working at peak efficiency. We’ll also be giving out LibreOffice Contributor T-shirts to all participants, as a thank-you for your hard work!

To Sign Up, send an email to qubit [at] libreoffice.org with your Name and T-Shirt size. Let us know if you’re interested in the Bug Triaging Bee, the Hackfest, or both!

For more information, please see the Seattle LibreFest event page.

Continue reading