GSP
Quick Navigator

Search Site

Unix VPS
A - Starter
B - Basic
C - Preferred
D - Commercial
MPS - Dedicated
Previous VPSs
* Sign Up! *

Support
Contact Us
Online Help
Handbooks
Domain Status
Man Pages

FAQ
Virtual Servers
Pricing
Billing
Technical

Network
Facilities
Connectivity
Topology Map

Miscellaneous
Server Agreement
Year 2038
Credits
 

USA Flag

 

 

Man Pages
YAML::PP(3) User Contributed Perl Documentation YAML::PP(3)
 

YAML::PP - YAML Framework

WARNING: This is highly experimental.
Here are a few examples of what you can do right now:
    my $yppl = YAML::PP::Loader->new;
    my @documents = $yppl->load_string($yaml);
    # load file
    my $yppl = YAML::PP::Loader->new;
    my @documents = $yppl->load_file($filename);
    # The loader offers JSON::PP, boolean.pm or pureperl 1/0 (default)
    # for booleans
    my $yppl = YAML::PP::Loader->new(boolean => 'JSON::PP');
    my ($data1, $data2) = $yppl->load_string($yaml);
    my $yppd = YAML::PP::Dumper->new();
    my $yaml = $yppd->dump_string($data1, $data2);
Some utility scripts:
    # Load YAML into a very simple data structure
    yamlpp5-load < file.yaml
    # Load and dump
    yamlpp5-load-dump < file.yaml
    # Print the events from the parser in yaml-test-suite format
    yamlpp5-events < file.yaml
    # Create ANSI colored YAML
    yamlpp5-highlight < file.yaml

This is Yet Another YAML Framework. For why this project was started, see "WHY".
The parser aims to parse "YAML 1.2". See <http://yaml.org/>.
You can check out all current parse and load results from the yaml-test-suite here: <https://perlpunk.github.io/YAML-PP-p5/test-suite.html>
YAML::PP::Lexer
The Lexer is reading the YAML stream into tokens. This makes it possible to generate syntax highlighted YAML output.
Note that the API to retrieve the tokens will change.
YAML::PP::Parser
The Parser retrieves the tokens from the Lexer. The main YAML content is then parsed with the Grammar.
YAML::PP::Grammar
YAML::PP::Constructor
The Constructor creates a data structure from the Parser events.
YAML::PP::Loader
The Loader combines the constructor and parser.
YAML::PP::Dumper
The Dumper will create Emitter events from the given data structure.
YAML::PP::Emitter
The Emitter creates a YAML stream.

Still TODO:
Flow Style
Flow style is partially implemented.
Not yet working: Implicit flow collection keys, implicit keys in flow sequences, content directly after the colon, empty nodes, explicit keys
Supported Characters
If you have valid YAML that's not parsed, or the other way round, please create an issue.
Line Numbers
You will see line numbers in the error message. They might still be wrong in some cases.
Error Messages
The error messages need to be improved. Column information is still missing.
Possibly more

The Constructor is very simple so far.
It supports:
Simple handling of Anchors/Aliases
Like in modules like YAML, the Constructor will use references for mappings and sequences, but obviously not for scalars.
Boolean Handling
You can choose between 'perl' (default), 'JSON::PP' and 'boolean'.pm for handling boolean types. That allows you to dump the data structure with one of the JSON modules without losing information about booleans.
I also would like to add the possibility to specify a callback for your own boolean handling.
Numbers
Numbers are created as real numbers instead of strings, so that they are dumped correctly by modules like JSON::PP or JSON::XS, for example.
See "NUMBERS" for an example.
TODO:
Complex Keys
Mapping Keys in YAML can be more than just scalars. Of course, you can't load that into a native perl structure. The Constructor will stringify those keys with Data::Dumper. I would like to add a possibility to specify a method for stringification.
Example:
    use YAML::PP::Loader;
    use JSON::PP;
    my $yppl = YAML::PP::Loader->new;
    my $coder = JSON::PP->new->ascii->pretty->allow_nonref->canonical;
    my $yaml = <<'EOM';
    complex:
        ?
            ?
                a: 1
                c: 2
            : 23
        : 42
    EOM
    my $data = $yppl->load_string($yaml);
    say $coder->encode($data);
    __END__
    {
       "complex" : {
          "{'{a => 1,c => 2}' => 23}" : 42
       }
    }
    
Tags
Tags are completely ignored.
Parse Tree
I would like to generate a complete parse tree, that allows you to manipulate the data structure and also dump it, including all whitespaces and comments. The spec says that this is throwaway content, but I read that many people wish to be able to keep the comments.

This is also pretty simple so far. Any string containing something other than "0-9a-zA-Z.-" will be dumped with double quotes.
It will recognize JSON::PP::Boolean and boolean.pm objects and dump them correctly.
The layout is like libyaml output:
    key:
    - a
    - b
    - c
    ---
    - key1: 1
      key2: 2
      key3: 3
    ---
    - - a1
      - a2
    - - b1
      - b2

Compare the output of the following YAML Loaders and JSON::PP dump:
    use JSON::PP;
    use Devel::Peek;
    use YAML::XS ();
    use YAML ();
        $YAML::Numify = 1; # since version 1.23
    use YAML::Syck ();
        $YAML::Syck::ImplicitTyping = 1;
    use YAML::Tiny ();
    use YAML::PP::Loader;
    my $yaml = "foo: 23";
    my $d1 = YAML::XS::Load($yaml);
    my $d2 = YAML::Load($yaml);
    my $d3 = YAML::Syck::Load($yaml);
    my $d4 = YAML::Tiny->read_string($yaml)->[0];
    my $d5 = YAML::PP::Loader->new->load_string($yaml);
    Dump $d1->{foo};
    Dump $d2->{foo};
    Dump $d3->{foo};
    Dump $d4->{foo};
    Dump $d5->{foo};
    say encode_json($d1);
    say encode_json($d2);
    say encode_json($d3);
    say encode_json($d4);
    say encode_json($d5);
    SV = PVIV(0x55bbaff2bae0) at 0x55bbaff26518
      REFCNT = 1
      FLAGS = (IOK,POK,pIOK,pPOK)
      IV = 23
      PV = 0x55bbb06e67a0 "23"\0
      CUR = 2
      LEN = 10
    SV = PVMG(0x55bbb08959b0) at 0x55bbb08fc6e8
      REFCNT = 1
      FLAGS = (IOK,pIOK)
      IV = 23
      NV = 0
      PV = 0
    SV = IV(0x55bbaffcb3b0) at 0x55bbaffcb3c0
      REFCNT = 1
      FLAGS = (IOK,pIOK)
      IV = 23
    SV = PVMG(0x55bbaff2f1f0) at 0x55bbb08fc8c8
      REFCNT = 1
      FLAGS = (POK,pPOK,UTF8)
      IV = 0
      NV = 0
      PV = 0x55bbb0909d00 "23"\0 [UTF8 "23"]
      CUR = 2
      LEN = 10
    SV = PVMG(0x55bbaff2f6d0) at 0x55bbb08b2c10
      REFCNT = 1
      FLAGS = (IOK,pIOK)
      IV = 23
      NV = 0
      PV = 0
    {"foo":"23"}
    {"foo":23}
    {"foo":23}
    {"foo":"23"}
    {"foo":23}

All the available parsers and loaders for Perl are behaving differently, and more important, aren't conforming to the spec. YAML::XS is doing pretty well, but "libyaml" only handles YAML 1.1 and diverges a bit from the spec. The pure perl loaders lack support for a number of features.
I was going over YAML.pm issues end of 216, integrating old patches from rt.cpan.org and creating some pull requests myself. I realized that it would be difficult to patch YAML.pm to parse YAML 1.1 or even 1.2, and it would also break existing usages relying on the current behaviour.
In 2016 Ingy döt Net initiated two really cool projects:
"YAML TEST SUITE"
"YAML EDITOR"
These projects are a big help for any developer. So I got the idea to write my own parser and started on New Year's Day 2017. Without the test suite and the editor I would have never started this.
I also started another YAML Test project which allows to get a quick overview of which frameworks support which YAML features:
"YAML TEST MATRIX"

<https://github.com/yaml/yaml-test-suite>
It contains about 230 test cases and expected parsing events and more. There will be more tests coming. This test suite allows to write parsers without turning the examples from the Specification into tests yourself. Also the examples aren't completely covering all cases - the test suite aims to do that.
The suite contains .tml files, and in a seperate 'data' branch you will find the content in seperate files, if you can't or don't want to use TestML.
Thanks also to Felix Krause, who is writing a YAML parser in Nim. He turned all the spec examples into test cases.

This is a tool to play around with several YAML parsers and loaders in vim.
<https://github.com/yaml/yaml-editor>
The project contains the code to build the frameworks (16 as of this writing) and put it into one big Docker image.
It also contains the yaml-editor itself, which will start a vim in the docker container. It uses a lot of funky vimscript that makes playing with it easy and useful. You can choose which frameworks you want to test and see the output in a grid of vim windows.
Especially when writing a parser it is extremely helpful to have all the test cases and be able to play around with your own examples to see how they are handled.

I was curious to see how the different frameworks handle the test cases, so, using the test suite and the docker image, I wrote some code that runs the tests, manipulates the output to compare it with the expected output, and created a matrix view.
<https://github.com/perlpunk/yaml-test-matrix>
You can find the latest build at <http://matrix.yaml.io>
As of this writing, the test matrix only contains valid test cases. Invalid ones will be added.

Copyright 2017 by Tina Müller
This library is free software and may be distributed under the same terms as perl itself.
2017-11-23 perl v5.28.1

Search for    or go to Top of page |  Section 3 |  Main Index

Powered by GSP Visit the GSP FreeBSD Man Page Interface.
Output converted with ManDoc.