Yaml parser (New) (#2383)

* First full run

* First translated smoke + builtin

* Imports are now array in yaml

* Jobs may also contain yaml units

* Accessed paramteres are now variadically text or array

* Remove duplicated Visitors

* Remove duplicated Visitors

* Templatable fields are now variadic (list or str)

* Siblings are now yaml so no more json parsing

* Support creating words from pre-parsed nodes

* Handle sibling multi type in the getter

* Wrong getter from setup_include

* Missing parameter to MissingParameter explorer

* Translate the metabox provider

* Depends is now a list

* Siblings are now always parsed in the getter

* Summary is no longer forced variant

This didnt work before because it was also forced translatable and when
that was the case the forced variant check was skipped (sigh). This
removes both

* Siblings are json

* Fix environ may be list or str

* Black formatting

* Package yaml units

* Add backward compatibility notes on isinstance

Minor: use list comprehension to parse resource

* Test and cover parse_import_stmt

* Correctly track origin of yaml units

* Test new yaml unit loader

* Test from preparsed xparsers calls

Minor: raise an exception instead of assert

* Test init and better documentation

* Fix origin is not raw data, use kwargs

* Deduplicate sibling code and fix flags for manual jobs

flags weren't correctly treatedfor manual after suspend jobs because I
didn't notice them. Now the code is unique so it is easier to make
changes for both

* Also check after and depends

* Enforce no trailing comma due to Python3.5

* Make black happy

* More coverage for test_v1

* Descriptions are summary, fixed most issues in PR review

* Test should test

* Rephrase comment

* Fix typo in function name

* Fix comments to call dicts dicts

Author: Hook25

checkbox-ng/MANIFEST.in

@@ -12,19 +12,24 @@ exclude mk-venv
 exclude tox.ini
 
 include plainbox/impl/resource_constants.yaml
+
 include plainbox/impl/providers/categories/README.md
 include plainbox/impl/providers/categories/manage.py
 include plainbox/impl/providers/categories/po/*.po
 include plainbox/impl/providers/categories/po/*.pot
 include plainbox/impl/providers/categories/po/POTFILES.in
 include plainbox/impl/providers/categories/units/*.pxu
+include plainbox/impl/providers/categories/units/*.yml
+include plainbox/impl/providers/categories/units/*.yaml
 
 include plainbox/impl/providers/exporters/README.md
 include plainbox/impl/providers/exporters/manage.py
 include plainbox/impl/providers/exporters/po/*.po
 include plainbox/impl/providers/exporters/po/*.pot
 include plainbox/impl/providers/exporters/po/POTFILES.in
 include plainbox/impl/providers/exporters/units/*.pxu
+include plainbox/impl/providers/exporters/units/*.yml
+include plainbox/impl/providers/exporters/units/*.yaml
 include plainbox/impl/providers/exporters/data/*
 
 include plainbox/impl/providers/manifest/README.md
@@ -34,6 +39,9 @@ include plainbox/impl/providers/manifest/po/*.po
 include plainbox/impl/providers/manifest/po/*.pot
 include plainbox/impl/providers/manifest/po/POTFILES.in
 include plainbox/impl/providers/manifest/units/*.pxu
+include plainbox/impl/providers/manifest/units/*.yml
+include plainbox/impl/providers/manifest/units/*.yaml
+
 include plainbox/vendor/inxi
 
 recursive-exclude daily-package-testing *

checkbox-ng/plainbox/impl/ctrl.py

@@ -208,7 +208,7 @@ def _is_job_impacting_suspend(self, suspend_job_id, job):
         if job.flags and expected_flag in job.flags:
             return True
         if job.siblings:
-            for sibling_data in json.loads(job.tr_siblings()):
+            for sibling_data in job.siblings:
                 if suspend_job_id in sibling_data.get("depends", []):
                     return True
         return False

…roviders/categories/units/categories.pxu …oviders/categories/units/categories.yamlcheckbox-ng/plainbox/impl/providers/categories/units/categories.pxu renamed to checkbox-ng/plainbox/impl/providers/categories/units/categories.yaml checkbox-ng/plainbox/impl/providers/categories/units/categories.pxu renamed to checkbox-ng/plainbox/impl/providers/categories/units/categories.yaml

@@ -1,159 +1,159 @@
 unit: category
 id: audio
-_name: Audio tests
-
+name: Audio tests
+---
 unit: category
 id: benchmarks
-_name: Benchmarks tests
-
+name: Benchmarks tests
+---
 unit: category
 id: bluetooth
-_name: Bluetooth tests
-
+name: Bluetooth tests
+---
 unit: category
 id: camera
-_name: Camera tests
-
+name: Camera tests
+---
 unit: category
 id: codecs
-_name: Codec tests
-
+name: Codec tests
+---
 unit: category
 id: cpu
-_name: CPU tests
-
+name: CPU tests
+---
 unit: category
 id: daemons
-_name: System Daemon tests
-
+name: System Daemon tests
+---
 unit: category
 id: disk
-_name: Disk tests
-
+name: Disk tests
+---
 unit: category
 id: ethernet
-_name: Ethernet Device tests
-
+name: Ethernet Device tests
+---
 unit: category
 id: esata
-_name: eSATA disk tests
-
+name: eSATA disk tests
+---
 unit: category
 id: fingerprint
-_name: Fingerprint reader tests
-
+name: Fingerprint reader tests
+---
 unit: category
 id: firewire
-_name: Firewire disk tests
-
+name: Firewire disk tests
+---
 unit: category
 id: firmware
-_name: Firmware tests
-
+name: Firmware tests
+---
 unit: category
 id: floppy
-_name: Floppy disk tests
-
+name: Floppy disk tests
+---
 unit: category
 id: graphics
-_name: Graphics tests
-
+name: Graphics tests
+---
 unit: category
 id: hibernate
-_name: Hibernation tests
-
+name: Hibernation tests
+---
 unit: category
 id: info
-_name: Informational tests
-
+name: Informational tests
+---
 unit: category
 id: input
-_name: Input Devices tests
-
+name: Input Devices tests
+---
 unit: category
 id: keys
-_name: Hotkey tests
-
+name: Hotkey tests
+---
 unit: category
 id: led
-_name: LED tests
-
+name: LED tests
+---
 unit: category
 id: mediacard
-_name: Media Card tests
-
+name: Media Card tests
+---
 unit: category
 id: memory
-_name: Memory tests
-
+name: Memory tests
+---
 unit: category
 id: mir
-_name: MIR tests
-
+name: MIR tests
+---
 unit: category
 id: miscellanea
-_name: Miscellaneous tests
-
+name: Miscellaneous tests
+---
 unit: category
 id: monitor
-_name: Monitor tests
-
+name: Monitor tests
+---
 unit: category
 id: networking
-_name: Non-device specific networking tests
-
+name: Non-device specific networking tests
+---
 unit: category
 id: optical
-_name: Optical Drive tests
-
+name: Optical Drive tests
+---
 unit: category
 id: expresscard
-_name: ExpressCard tests
-
+name: ExpressCard tests
+---
 unit: category
 id: peripheral
-_name: Peripheral tests
-
+name: Peripheral tests
+---
 unit: category
 id: power-management
-_name: Power Management tests
-
+name: Power Management tests
+---
 unit: category
 id: suspend
-_name: Suspend tests
-
+name: Suspend tests
+---
 unit: category
 id: touchpad
-_name: Touchpad tests
-
+name: Touchpad tests
+---
 unit: category
 id: touchscreen
-_name: Touchscreen tests
-
+name: Touchscreen tests
+---
 unit: category
 id: usb
-_name: USB tests
-
+name: USB tests
+---
 unit: category
 id: user_apps
-_name: User Applications
-
+name: User Applications
+---
 unit: category
 id: virtualization
-_name: Virtualization tests
-
+name: Virtualization tests
+---
 unit: category
 id: wireless
-_name: Wireless networking tests
-
+name: Wireless networking tests
+---
 unit: category
 id: mobilebroadband
-_name: Mobile broadband tests
-
+name: Mobile broadband tests
+---
 unit: category
 id: stress
-_name: Stress tests
-
+name: Stress tests
+---
 unit: category
 id: uncategorised
-_name: Uncategorised
+name: Uncategorised