Michal Čihař - Archive for Jan. 1, 2016

Last week was mostly focused on our libraries. I got merged several patches to our SQL parser from Deven and I've spent quite some time on ShapeFile library, which got several improvements.

It all started with one issue being reported and it actually pushed me to fix older issue - lack of tests. Few commits later the coverage went up to 92% and several bugs were fixed on the way, as some parts of the code were simply broken and nobody has used them so far.

Handled issues:

• #12710 unneeded check for <
• #12287 Remove CSS classses odd and even
• #12704 Point type handling
• #12698 Added 'view changelog' to newer version alert
• #12694 Create a new file with new updating functions
• #12711 Fix #12361 : Fix self SQL injection in table-specific privileges
• #12696 Fix #12299: Change to POST request to avoid possibly very long URIs
• #12443 Additional type check for db_export.php
• #12563 Fix error check of a routine execution
• #12360 Self SQL injection in user group name
• #41 Invalid certificate (domain mismatch) for mail.phpmyadmin.net
• #62 Good for your job, but, in some condition it may not work well as expected
• #100 Fix broken incorrect clause order detection for Joins
• #99 Add parsing End options like FOR UPDATE and LOCK IN SHARE MODE in Select
• #18 Test dbf lookup
• #12 Bug in Polygon/Polyline creation with multiple parts
• #17 Correctly work withou configured dbf header
• #16 Complex tests
• #15 Add tests for polyline
• #14 Use generic PHP 7.1 in Travis
• #13 Fixes phpmyadmin/shapefile#12

Hosted Weblate provides also free hosting for free software projects. I'm quite slow in processing the hosting requests, but when I do that, I process them in a batch and add several projects at once.

This time, the newly hosted projects include:

• Harbour AllRadio - a radio player for online streaming radio (on Sailfishos/jolla mobile)
• Simpletask - a GTD tool for Android
• FSearch - a fast file search utility for GNU/Linux based on GTK+3
• Peek - a simple animated Gif screen recorder for Linux
• QTodoTxt - a cross platform todo.txt GUI
• Stykur - fitness journal for Android and iOS
• walabag - a self hostable application for saving web pages

If you want to support this effort, please donate to Weblate, especially recurring donations are welcome to make this service alive. You can do them on Liberapay or Bountysource.

Since today all Git repositories from Hosted Weblate are exported over https. The previous git URLs will continue to work for some time. The exact depreciation schedule is not yet decided as this URL might be included in various scripts and there is nothing pushing us to disable the service.

The new Git URLs are consistent with Weblate URLs, just with /git/ in the path, so for example when your project is https://hosted.weblate.org/projects/weblate/website/, you can clone it using git clone https://hosted.weblate.org/git/weblate/website/.

Another important change is for private repositories, this now requires authentication using API key. You can specify it on the clone URL (git clone https://user:key@hosted.weblate.org/git/weblate/website/) or use gitcredentials to store it separately. The API key can be obtained from your user profile API page (once you're authenticated to Weblate).

After week of silence (and sickness) I again did some work on phpMyAdmin. Again it was mostly focused on cleaning up piled issues and pull requests and it worked quite well.

Several of them needed minor changes before they can be safely merged and they were waiting for these for several weeks. In the end I've processed most of them and merged them with needed cleanups or polishing.

Handled issues:

• #12372 Fixes #12322, no default function selected for foreignkey fields
• #12564 Properly escape strings in MySQL statement values
• #12519 Fixes #12514 - Uses sys_get_temp_dir in place of empty string for temporary file creation
• #12322 UUID, wrong relation INSERT statements
• #12363 Fixes #12352 - password strength simulator
• #12352 Adding Password Strength Simulator
• #12369 Fixes #12361 and #12360 - Self XSS
• #12685 Use a work around for testing if numRecords at least N
• #12688 Bookmark id that is an auto_increment column can only take positive v…
• #12686 Missing punctuation
• #12689 Add LEFT JOIN only for different constraints
• #12160 Designer not working with MySQL relations only
• #12676 Create upgrade_column_info_4_6_5+.sql
• #12629 Safari 10
• #12683 Fix #12681
• #12666 Fix #12651: Allow for all MySQL-allowed Date values
• #12675 Stable
• #12678 Allow for proper MySQL-allowed strings as identifiers
• #80 Unable to access phpMyAdmin
• #97 In SQL we should use 'column' and not 'field'
• #98 Fix test for terminology change
• #96 Fix #22 : Validate order of clauses in the parsing of statements

Slightly behind schedule (it should have been released in October), Weblate 2.9 is out today. This release brings Subversion support or improved zen mode.

Full list of changes:

• Extended parameters for createadmin management command.
• Extended import_json to be able to handle with existing components.
• Added support for YAML files.
• Project owners can now configure translation component and project details.
• Use "Watched" instead of "Subscribed" projects.
• Projects can be watched directly from project page.
• Added multi language status widget.
• Highlight secondary language if not showing source.
• Record suggestion deletion in history.
• Improved intuitivity of languages selection in profile.
• Fixed showing whiteboard messages for component.
• Keep preferences tab selected after saving.
• Show source string comment more prominently.
• Automatically install Gettext PO merge driver for Git repositories.
• Added search and replace feature.
• Added support for uploading visual context (screnshots) for translations.

If you are upgrading from older version, please follow our upgrading instructions.

You can find more information about Weblate on https://weblate.org, the code is hosted on Github. If you are curious how it looks, you can try it out on demo server. You can login there with demo account using demo password or register your own user. Weblate is also being used on https://hosted.weblate.org/ as official translating service for phpMyAdmin, OsmAnd, Aptoide, FreedomBox, Weblate itself and many other projects.

Should you be looking for hosting of translations for your project, I'm happy to host them for you or help with setting it up on your infrastructure.

Further development of Weblate would not be possible without people providing donations, thanks to everybody who have helped so far! The roadmap for next release is just being prepared, you can influence this by expressing support for individual issues either by comments or by providing bounty for them.

Last week was a bit calmer and was really focused mostly on the bug screening and merging pull requests than on actual work. I've however managed to release new version of SQL parser with several fixes contributed by Deven.

Handled issues:

• #12667 Adding Themes
• #12626 Fix bug #12234 No page indicator in view
• #12648 Fix submission of 'Save page' form using Enter keypress
• #12654 Allow for all MySQL values of TIME data type
• #12657 Update ckb.po
• #12658 Update ca.po
• #78 Remove additional not needed files
• #94 Enable Lexing of begin_label in the in-procedure statements
• #95 Fix #93 : Fix parsing of NATURAL JOIN, CROSS JOIN and related joins

Today, new version has been deployed on Hosted Weblate. It brings many long requested features and enhancements.

Adding project to watched got way simpler, you can now do it on the project page using watch button:

Another feature which will be liked by project admins is that they can now change project metadata without contacting me. This works for both project and component level:

And adding some fancy things, there is new badge showing status of translations into all languages. This is how it looks for Weblate itself:

As you can see it can get pretty big for projects with many translations, but you get complete picture of the translation status in it.

You can find all these features in upcoming Weblate 2.9 which should be released next week. Complete list of changes in Weblate 2.9 is described in our documentation.

Last week got again more focus on bug fixing. Mostly those were again hardenings on our infrastructure and Docker image, but there were some fixes as well. Overall the phpMyAdmin docker image got much better and it will be be even better with upcoming 4.6.5 release which adds some improvements to the main codebase.

Handled issues:

• #12640 Missing SPF
• #12643 Missing SSL support in mail.phpmyadmin.net
• #12645 Add documentaton checks to be executed in Travis CI
• #12628 AJAX request for exporting SQL results causes 403 Forbidden error
• #12647 Use justBrowsing only if outputting the results from a single table
• #12646 Incorrect protocol number at 500 header
• #12631 Fix order of testing DBConnection with different parameters in Config method
• #12616 Refuse to work with mbstring.func_overload enabled
• #12632 Use IDENTIFIED BY 'auth_string' if password check plugin is active
• #64 Missing white-list of allowed HTTP methods (in nginx.conf)
• #63 increased attack surface by internal redirect in try_files option
• #67 Deny access to all hidden files
• #77 Improve nginx setup
• #73 User configuration not taken into account
• #74 Fix user configuration and add tests for it
• #76 Avoid encoding PHP version in socket or log name
• #68 Incorrect PHP log/socket name
• #71 Performance Improvements to Test
• #75 Optimize PHP opcache settings
• #69 not needed sections in php.ini
• #70 Missing optional dependencies:
• #33 Missing HSTS header
• #32 Missing Redirect to HTTPS from HTTP
• #34 HTTPS to HTTP Redirect
• #38 Exposed old (not latest) PMA interface with setup
• #6 Update id.po
• #4 Update id.po
• #5 Update id.po

Yesterday Gammu 1.37.90 has been released. This release brings quite a lot of changes and it's for testing purposes. Hopefully stable 1.38.0 will follow soon as soon as I won't get negative feedback on the changes.

Besides code changes, there is one news for Windows users - there is Windows binary coming with the release. This was possible to automate thanks to AppVeyor, who does provide CI service where you can download built artifacts. Without this, I'd not be able to do make this as I don't have single Windows computer :-).

Full list of changes:

• Improved support Huawei K3770.
• API changes in some parameter types.
• Fixed various Windows compilation issues.
• Fixed several resource leaks.
• Create outbox SMS atomically in FILES backend.
• Removed getlocation command as we no longer fit into their usage policy.
• Fixed call diverts on TP-LINK MA260.
• Initial support for Oracle database.
• Removed unused daemons, pbk and pbk_groups tables from the SMSD schema.
• SMSD outbox entries now can have priority set in the database.
• Added SIM IMSI to the SMSD status table.
• Added CheckNetwork directive.
• SMSD attempts to power on radio if disabled.
• Fixed processing of AT unsolicited responses in some cases.
• Fixed parsing USSD responses from some devices.

Would you like to see more features in Gammu? You an support further Gammu development at Bountysource salt or by direct donation.

Last week was mostly focused on motranslator and removing it's usage of eval(). After introducing library to do the expression evaluation, I've learned that there is already existing library having all features we need - symfony/expression-language. There could be better way to learn this, but still lesson learned and I will evaluate existing libraries more carefully next time. Now the motranslator 2.0 is out without eval() and with dependency on symfony/expression-language.

Besides that there was some discussion about improving quality of our documentation translations by using automated checks. The set of such checks is already provided by Weblate, but it really doesn't cover RST markup and some improvements could be borrowed from the dennis tool.

Handled issues:

• #12617 Fatal error: Call to undefined function __() in /usr/share/phpmyadmin/libraries/core.lib.php on line 235
• #5 Remove use of eval()
• #2 Fix issues found using dennis
• #3 Added Indonesian translation