Overview
The following study describes extending YANG language statements to allow customization of models.
References:
YANG Language
- The YANG language provides us the ability to define and model configurations and state data by defining YANG modules
- Modules contain a sequence of statements
- Statement syntax is either of the following :
- statement = keyword [argument] ;
- statement = keyword [argument] { <substatement(s)..> } ;
* argument can be zero or one depending on the statement
* argument is a string
...
container nodes
...
Sample YANG
(stores.yang)
...
language | text |
---|
theme | Confluence |
---|
linenumbers | true |
---|
...
Overview
The following study describes extending YANG language statements to allow customization of models.
References:
YANG Language
- The YANG language provides us the ability to define and model configurations and state data by defining YANG modules
- Modules contain a sequence of statements
- Statement syntax is either of the following :
- statement = keyword [argument] ;
- statement = keyword [argument] { <substatement(s)..> } ;
* argument can be zero or one depending on the statement
* argument is a string
- An XML-based equivalent version of YANG is called YIN
- YANG uses a tree to define the hierarchy of data wherein each ‘node’ has a value or/and a set of child nodes
- 4 types of nodes
container nodes
- list nodes
- leaf nodes
- leaf-list nodes
Basic YANG statements
Sample YANG (stores.yang) | Statements and Description |
---|
Code Block |
---|
language | text |
---|
theme | Confluence |
---|
title | stores model |
---|
linenumbers | true |
---|
| module stores {
yang-version 1.1;
namespace "org:onap:ccsdk:sample";
prefix book-store;
revision "2020-09-15" {
description
"Sample Model";
}
typedef year {
type uint16 {
range "1000..9999";
}
}
container bookstore {
leaf bookstore-name {
type string;
}
list categories {
key "code";
leaf code {
type string;
}
leaf name {
type string;
}
list books {
key title;
leaf title {
type string;
}
leaf-list authors {
type string;
}
}
}
}
}
|
| module Statement see example from Line 1 - YANG language defines models with modules and submodules
- Takes one argument (module name) which is the identifier
- Groups all statements that belong to the module
- This module example contains the following statements for header information:
see examples from Lines 2-16 - yang-version statement
- namespace statement prefix statement
- revision statements
typedef Statement see example from Line 12 - a statement that allows a new type to be defined based on a base type which is a YANG built-in type
container Statement see example from Line 18 - defines interior (container node) in the schema tree
- only contains child nodes, has no value
- child nodes can be a leaf, lists, containers and leaf-lists
leaf Statement see example from Line 27 - defines a leaf node in the schema tree
- its only one argument is the identifier
- has no child nodes, has one value of a particular type
- 'type statement' is mandatory
- See optional substatements available in (Section 7.6 https://www.hjp.at/doc/rfc/rfc6020.html#sec_1)
list Statement see example from Line 35 - defines an interior data node (list node) in the schema tree
- its only one argument is the identifier
- follows a block of substatements:
- mandatory substatements:
leaf-list Statement see example from Line 41 - array of leaf nodes
- one value of a particular type per leaf
- its only one argument is the identifier
|
Figure 1.1 Schema tree of module 'stores'
Code Block |
---|
language | xml |
---|
title | Schema tree of module 'stores' |
---|
|
module: stores
+--rw bookstore
+--rw bookstore-name? string
+--rw categories* [code]
+--rw code string
+--rw name? string
+--rw books* [title]
+--rw title string
+--rw lang? string
+--rw authors* |
...
...
...
...
...
...
...
YANG extension Statement
Sample YANG (stores.yang with extension) | Statements and Description |
---|
Code Block |
---|
language | yml |
---|
title | stores model with extension |
---|
linenumbers | true |
---|
| module sync-extension {
…
prefix sync-ext;
…
extension sync-flag{
|
|
typestring;}leafname{ type string
The following model shows that it imported the model above where extensions is declared. Code Block |
---|
language | yml |
---|
title | extended-stores model |
---|
linenumbers | true |
---|
| module extended-stores {
|
|
listbooks{
yang-version 1.1;
...
import sync-extension{
|
|
keytitlesync-ext;
}
typedef year {
|
|
leaftitle{type string leaf-list authors type string
| extension Statement see example from Lines 5-9 on stores model with extension Code Block |
---|
| extension <keyword/identifier>{
|
|
} <extension substatements...>
} |
|
}
}
module Statement 1- YANG language defines models with modules and submodules
- Takes one argument (module name) which is the identifier
- Groups all statements that belong to the module
- This module example contains the following statements for header information:
see examples from Lines 2-16
- yang-version statement
- namespace statement prefix statement
- revision statements
typedef Statement
see example from Line 12
- a statement that allows a new type to be defined based on a base type which is a YANG built-in type
container Statement
see example from Line 18
- defines interior (container node) in the schema tree
- only contains child nodes, has no value
- child nodes can be a leaf, lists, containers and leaf-lists
leaf Statement
see example from Line 27
- defines a leaf node in the schema tree
- its only one argument is the identifier
- has no child nodes, has one value of a particular type
- 'type statement' is mandatory
- See optional substatements available in (Section 7.6 https://www.hjp.at/doc/rfc/rfc6020.html#sec_1)
list Statement
see example from Line 35
- defines an interior data node (list node) in the schema tree
- its only one argument is the identifier
- follows a block of substatements:
- mandatory substatements:
leaf-list Statement
see example from Line 41
- array of leaf nodes
- one value of a particular type per leaf
- its only one argument is the identifier
Figure 1.1 Schema tree of module 'stores'
Code Block |
---|
language | xml |
---|
title | Schema tree of module 'stores' |
---|
|
module: stores
+--rw bookstore
+--rw bookstore-name? string
+--rw categories* [code]
+--rw code string
+--rw name? string
+--rw books* [title]
+--rw title string
+--rw lang? string
+--rw authors* string
+--rw pub_year? year
+--rw price? uint64 |
YANG extension Statement
Sample YANG (stores.yang with extension) | Statements and Description |
---|
Code Block |
---|
language | yml |
---|
linenumbers | true |
---|
| module stores {
…
prefix book-store;
…
extension sampleExtension{
description
“This is a sample extension statement description“
argument name {
yin-element true;
}
}
container bookstore {
leaf bookstore-name {
type string;
}
….
}
|
Code Block |
---|
language | yml |
---|
linenumbers | true |
---|
| module example-module2{
…
import stores {
prefix book-store;
}
book-store:sampleExtension locations {
list address {
key "state";
leaf state {
type string;
description "State name"{
book-store:sampleExtension-b "b-sample-name";
15 on extended-stores model Code Block |
---|
| <module prefix>:<extension keyword> "argument"; |
- to be used to define new statements
- available to be imported and used by other modules just like a normal YANG statement
- by use of 'import statement' to import the module where the extension is defined
- statements that do not have any substatements can have extensions defined if wanted
- its only one argument is the identifier and keyword for the extension
- Optional substatements:
- argument Statement
- description Statement
- reference Statement
- defined extension Statements
argument Statement see examples from Line 6 on stores model - takes a string argument which is the name of the argument to the keyword
- Optional substatement
|
Code Block |
---|
language | xml |
---|
theme | Midnight |
---|
title | YIN-extended-stores model |
---|
linenumbers | true |
---|
| <?xml version="1.0" encoding="UTF-8"?>
<module name="extended-stores"
xmlns="urn:ietf:params:xml:ns:yang:yin:1"
xmlns:ext-book-store="org:onap:ccsdk:sampleExtended"
xmlns:book-store="org:onap:ccsdk:sample">
<namespace uri="org:onap:ccsdk:sampleExtended"/>
<prefix value="ext-book-store"/>
<revision date="2020-09-15">
<description>
<text>Sample Extended Model</text>
</description>
</revision>
<import module="sync-extension">
<prefix value="sync-ext"/>
</import>
<typedef name="year">
<type name="uint16">
<range value="1000..9999"/>
</type>
</typedef>
<container name="bookstore">
<sync-ext:sync-flag value="on"/>
<leaf name="bookstore-name">
<type name="string"/>
</leaf>
...
</container>
</module> |
| yin-element Statement - takes a string argument which is true or false
- yin-element is 'false' by default
- if the argument is 'true' it indicates that the argument is mapped to an XML element in YIN or to an XML attribute
Notes - Line 22 on YIN-extended-stores model
- result of using the argument without specifying the yin-element value
- yin-element is 'false'
- the argument 'value' is only an XML attribute
- if argument statement (Line 6 on stores model) contains yin-element substatement YIN-extend-stores model would result to the following:
extension statement will produce a child node Code Block |
---|
theme | Midnight |
---|
title | YIN-extended-stores model where yin-element is 'true' |
---|
| ...
<container name="bookstore">
<sync-ext:sync-flag>
<sync-ext:value>on</sync-ext:value>
</sync-ext:sync-flag>
...
</container>
... |
** extension does not extend the data
|
** the YIN version and Schema trees above are generated by YANG validator 'pyang'
Existing YANG parser in CPS
(Please see https://lf-onap.atlassian.net/wiki/display/DW/Existing+Yang+Parser)
OpenDayLight Yang tools recognize YANG extensions
Contains interface which has methods to access data of a YANG extension statement
Code Block |
---|
language | java |
---|
theme | Eclipse |
---|
title | Yang tools ExtensionDefinition Interface |
---|
|
package org.opendaylight.yangtools.yang.model.api;
import org.opendaylight.yangtools.yang.model.api.stmt.ExtensionEffectiveStatement;
public interface ExtensionDefinition extends SchemaNode, EffectiveStatementEquivalent<ExtensionEffectiveStatement> {
String getArgument();
boolean isYinElement();
} |
Test cases and scenarios
The following test cases used and modified the standard stores model seen above.
Testing with groovy
The following cases were tested in YangTextSchemaSourceSetSpec.groovy using the test method 'Building a valid YangTextSchemaSourceSet using #filenameCase filename)'.
Key
**Green cell for case number indicates that tests have passed
**Red cell for case number indicates that tests have failed
- the extension is defined as substatement in the module with argument statement as its substatement
Case # | Description | JAVA object | Notes |
1 | - extension used inside container statement before all other substatements
Code Block |
---|
| module stores {
yang-version 1.1;
...
extension sync-flag{
|
|
}description "This extension allows to tag nodes with a sync |
|
}leafcity{typestring;description"Cityname"{ sampleExtensioncc-sample-nameon";
...
leaf bookstore-name {...}
|
|
…. list categories {..}
...
} |
|
extension Statement
see example from Lines 5-11 on stores model
Code Block |
---|
|
extension <keyword/identifier> | Image Added | - extension declared after all other substatements of container still passed
|
2 | - extension used inside a leaf statement (child of a container) before all other substatements
Code Block |
---|
| module stores {
|
|
<extension substatements>
}see example from Lines
Code Block |
---|
|
<module prefix>:<extension keyword> "argument"; |
- to be used to define new statements
- available to be imported and used by other modules just like a normal YANG statement
- by use of 'import statement' to import the module where the extension is defined
- statements that do not have any substatements can have extensions defined if wanted
- its only one argument is the identifier and keyword for the extension
- Optional substatements:
- argument Statement
- description Statement
- reference Statement
- defined extension Statements
argument Statement
see examples from Lines on stores model
- takes a string argument which is the name of the argument to the keyword
- Optional substatement
Code Block |
---|
language | xml |
---|
theme | Midnight |
---|
linenumbers | true |
---|
|
<?xml version="1.0" encoding="UTF-8"?>
<module name="example-module2"
extension sync-flag{
description "This extension allows to tag nodes with a sync flag";
argument "value";
}
typedef year {...}
container bookstore {
...
leaf bookstore-name {
book-store:sync-flag "on";
}
list categories {..}
...
} |
| Image Added | - Extension declared after type-statement inside leaf statement (child of a container) still passed
|
3 | - extension used inside list statement (child of a container) before all other substatements
Code Block |
---|
| module stores {
yang-version 1.1;
...
extension sync-flag{
description |
|
xmlns="urn:ietf:params:xml:ns:yang:yin:1"
xmlns:em="org:onap:ccsdk:sample2""This extension allows to tag nodes with a sync flag";
argument |
|
xmlns:book-store="org:onap:ccsdk:sample"><yang-versionvalue="1.1"/>
<namespaceuri="org:onap:ccsdk:sample2"/><prefix value="em"/>
<import module="stores">
<prefix value="book-store"/>
</import>
<book-store:sampleExtension>
<book-store:name>locations</book-store:name>
<list name="address">
<key value="state"/>
<leaf name="state">
<type name="string"/>
<description>typedef year {...}
container bookstore {
...
leaf bookstore-name {...}
list categories {
book-store:sync-flag "on";
key "code";
...
}
...
} |
| Image Added | - Extension declared after key-statement inside list statement (child of a container) still passed
|
4 | - extension used inside leaf statement (child of list node from case #3) before all its substatements
Code Block |
---|
| module stores {
yang-version 1.1;
...
extension sync-flag{
description "This extension allows to |
|
<text>State name</text>
tag nodes with a sync flag";
|
|
<book-store:sampleExtension-b name="b-sample-name"/></description></leaf> <leafname="city"> <type name="string"/>{...}
list categories {
key "code";
|
|
<description><text>Cityname</text><booksampleExtension-c><book-store:name>c-sample-name</book-store:name>
</book-store:sampleExtension-c></description>
</leaf> </list>
</book-store:sampleExtension>
</module>yin-element Statement
- takes a string argument which is true or false
- yin-element is 'false' by default
- if the argument is 'true' it indicates that the argument is mapped to an XML element in YIN or to an XML attribute
- Line
Image Removed
Image Removed
** the YIN version and Schema trees above are generated by YANG validator 'pyang'
Expected tree diagram for example-module based on RFC8340 (https://datatracker.ietf.org/doc/html/rfc8340):
Gliffy |
---|
macroId | c27dcf5f-85dc-4861-a7db-ff726ab42e91 |
---|
displayName | Diagram 6 |
---|
name | Diagram 6 |
---|
pagePin | 2 |
---|
|
Existing YANG parser
(Please see https://wiki.onap.org/display/DW/Existing+Yang+Parser)
OpenDayLight Yang tools recognises YANG extensions
...
package org.opendaylight.yangtools.yang.model.api;
import org.opendaylight.yangtools.yang.model.api.stmt.ExtensionEffectiveStatement;
public interface ExtensionDefinition extends SchemaNode, EffectiveStatementEquivalent<ExtensionEffectiveStatement> {
String getArgument();
boolean isYinElement();
}
...
| Image Added | - Extension declared after type-statement inside leaf statement (child of list node from case #3) still passed
|
5 | - extension used inside list node (child of list node from case #4) before key-statement of list
Code Block |
---|
| module stores {
yang-version 1.1;
...
extension sync-flag{
description "This extension allows to tag nodes with a sync flag";
argument "value";
}
typedef year {...}
container bookstore {
leaf bookstore-name {...}
list categories {
key "code";
leaf code {...}
leaf name {...}
list books {
book-store:sync-flag "on";
...
}
...
} |
| Image Added | - extension declared after key-statement of the list statement still passed
|
6 | - extension used inside leaf-list node (child of list node from case #5) before all other substatements
Code Block |
---|
| module stores {
yang-version 1.1;
...
extension sync-flag{
description "This extension allows to tag nodes with a sync flag";
argument "value";
}
typedef year {...}
container bookstore {
leaf bookstore-name {...}
list categories {
key "code";
leaf code {...}
leaf name {...}
list books {
leaf-list authors{
book-store:sync-flag "on";
}
}
...
} |
| Image Added | - extension declared after type-statement of leaf-list still passed
|
7 | - extension used inside module
Code Block |
---|
| module stores {
yang-version 1.1;
...
extension sync-flag{
description "This extension allows to tag nodes with a sync flag";
argument "value";
}
typedef year {...}
book-store:sync-flag "on";
container bookstore {...}
} |
| Image Added | - data tree still only has one direct child (container node) as with the standard stores model
- value of the argument is not seen?
|
8 | - scenario the same as case 1 but the extension was used in the container statement without an argument
Code Block |
---|
| module stores {
yang-version 1.1;
...
extension sync-flag{
description "This extension allows to tag nodes with a sync flag";
argument "value";
}
typedef year {...}
container bookstore {
book-store:sync-flag;
...
} |
| Image Added | - same extension declaration/usage fails for:
- scenarios in all cases 2-7
|
9 | - no argument declared for extension
Code Block |
---|
| module stores {
yang-version 1.1;
...
extension sync-flag;
typedef year {...}
container bookstore {
book-store:sync-flag;
...
leaf bookstore-name {...}
list categories {..}
...
} |
| Image Added | - use of the same definition and declaration of the extension on this case for cases #1-7 passes
|
10 | - extension used twice
- inside container statement before all other substatements
- inside leaf statement (child of container statement)
Code Block |
---|
| module stores {
yang-version 1.1;
...
extension sync-flag;
typedef year {...}
container bookstore {
book-store:sync-flag;
...
leaf bookstore-name {
book-store:sync-flag;
}
list categories {..}
...
} |
| Image Added |
|
Extra Notes:
- There seems to be no inheritance of the extension statement for the substatements wherein the extension was used
- The date tree and schema tree does not change sizes with the addition of the extensions for all cases shown above
Parsing a original data instance (json) using the extended model
Case # | Description | Result |
---|
1 | - Created schema set
- the model contained only an extension definition
| - successfully stored yang resource
- successfully created a node using the model
- fragment table did not add the extension argument in attributes
|
2 | - Created schema set
- the model contained an extension definition and the model was used inside a container node
| - successfully stored yang resource
- successfully created a node using the model
- fragment table did not add the extension argument in attributes
*the same result acquired for all passed cases on the groovy tests table above |
3 | - Created schema set
- the model contained only an extension definition
- extension contains argument
| - creating the schema set failed
- received 500 server error parsing schema set
|
4 | - Created schema set
- the model contained an extension definition and was used inside the container node
- extension contains argument
| - creating the schema set failed
- received 500 server error parsing schema set
|
Conclusions
- The YANG language extension analysis above is only applicable for seeing that it is good for type configuration.
- The extension does not extend the actual data of the model instance
- Based on the test scenarios above, extensions can only be seen on the schema sets and not on the data
- YANG extension can be used at every level of the tree model
- The test results show that the model is being recognized by the current YANG tools used to parse a model
- It fails for scenarios such as parsing a model without an argument defined when it is expecting it
- This analysis did not look further into the effect of setting yin-element to 'true' for the model instance
- Further investigation is required to cover interpretation as the analysis above only covers parsing
- see
Jira Legacy |
---|
server | System Jira |
---|
serverId | 4733707d-2057-3a0f-ae5e-4fd8aff50176 |
---|
key | CPS-866 |
---|
|