• Stars
    star
    210
  • Rank 180,810 (Top 4 %)
  • Language
    Go
  • License
    MIT License
  • Created almost 6 years ago
  • Updated about 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

JSON xpath query for Go. Golang XPath query for JSON query.

jsonquery

Build Status GoDoc Go Report Card

Overview

jsonquery is XPath query package for JSON document depended on xpath package, writing in go.

jsonquery helps you easy to extract any data from JSON using XPath query without using pre-defined object structure to unmarshal in go, saving your time.

  • htmlquery - XPath query package for HTML document

  • xmlquery - XPath query package for XML document.

Install Package

go get github.com/antchfx/jsonquery

Get Started

The below code may be help your understand what it does. We don't need pre-defined structure or using regexp to extract some data in JSON file, gets any data is easy and fast in jsonquery now.

Using an xpath like syntax to access specific fields of a json structure.

// https://go.dev/play/p/vqoD_jWryKY
package main

import (
	"fmt"
	"strings"

	"github.com/antchfx/jsonquery"
)

func main() {
	s := `{
            "person":{
               "name":"John",
               "age":31,
               "female":false,
               "city":null,
               "hobbies":[
                  "coding",
                  "eating",
                  "football"
               ]
            }
         }`
	doc, err := jsonquery.Parse(strings.NewReader(s))
	if err != nil {
		panic(err)
	}
	// xpath query
	age := jsonquery.FindOne(doc, "age")
	// or
	age = jsonquery.FindOne(doc, "person/age")
	fmt.Printf("%#v[%T]\n", age.Value(), age.Value()) // prints 31[float64]

	hobbies := jsonquery.FindOne(doc, "//hobbies")
	fmt.Printf("%#v\n", hobbies.Value()) // prints []interface {}{"coding", "eating", "football"}
	firstHobby := jsonquery.FindOne(doc, "//hobbies/*[1]")
	fmt.Printf("%#v\n", firstHobby.Value()) // "coding"
}

Iterating over a json structure.

// https://go.dev/play/p/vwXQKTCLdVK
package main

import (
	"fmt"
	"strings"

	"github.com/antchfx/jsonquery"
)

func main() {
	s := `{
	"name":"John",
	"age":31,
	"female":false,
	"city":null
	}`
	doc, err := jsonquery.Parse(strings.NewReader(s))
	if err != nil {
		panic(err)
	}
	// iterate all json objects from child ndoes.
	for _, n := range doc.ChildNodes() {
		fmt.Printf("%s: %v[%T]\n", n.Data, n.Value(), n.Value())
	}
}

Output:

name: John[string]
age: 31[float64]
female: false[bool]
city: <nil>[<nil>]

The default Json types and Go types are:

JSON jsonquery(go)
object interface{}
string string
number float64
boolean bool
array []interface{}
null nil

For more information about JSON & Go see the https://go.dev/blog/json

Getting Started

Load JSON from URL.

doc, err := jsonquery.LoadURL("http://www.example.com/feed?json")

Load JSON from string.

s :=`{
    "name":"John",
    "age":31,
    "city":"New York"
    }`
doc, err := jsonquery.Parse(strings.NewReader(s))

Load JSON from io.Reader.

f, err := os.Open("./books.json")
doc, err := jsonquery.Parse(f)

Parse JSON array

s := `[1,2,3,4,5,6]`
doc, _ := jsonquery.Parse(strings.NewReader(s))
list := jsonquery.Find(doc, "*")
for _, n := range list {
	fmt.Print(n.Value().(float64))
}

// Output: 1,2,3,4,5,6

Convert JSON object to XML file

s := `[{"name":"John", "age":31, "female":false, "city":null}]`
doc, _ := jsonquery.Parse(strings.NewReader(s))
fmt.Println(doc.OutputXML())

Methods

FindOne()

n := jsonquery.FindOne(doc,"//a")

Find()

list := jsonquery.Find(doc,"//a")

QuerySelector()

n := jsonquery.QuerySelector(doc, xpath.MustCompile("//a"))

QuerySelectorAll()

list :=jsonquery.QuerySelectorAll(doc, xpath.MustCompile("//a"))

Query()

n, err := jsonquery.Query(doc, "*")

QueryAll()

list, err := jsonquery.QueryAll(doc, "*")

Query() vs FindOne()

  • Query() will return an error if give xpath query expr is not valid.

  • FindOne will panic error and interrupt your program if give xpath query expr is not valid.

OutputXML()

Convert current JSON object to XML format.

Example of how to convert JSON object to XML file

{
  "store": {
    "book": [
      {
        "id": 1,
        "category": "reference",
        "author": "Nigel Rees",
        "title": "Sayings of the Century",
        "price": 8.95
      },
      {
        "id": 2,
        "category": "fiction",
        "author": "Evelyn Waugh",
        "title": "Sword of Honour",
        "price": 12.99
      },
      {
        "id": 3,
        "category": "fiction",
        "author": "Herman Melville",
        "title": "Moby Dick",
        "isbn": "0-553-21311-3",
        "price": 8.99
      },
      {
        "id": 4,
        "category": "fiction",
        "author": "J. R. R. Tolkien",
        "title": "The Lord of the Rings",
        "isbn": "0-395-19395-8",
        "price": 22.99
      }
    ],
    "bicycle": {
      "color": "red",
      "price": 19.95
    }
  },
  "expensive": 10
}
doc, err := jsonquery.Parse(strings.NewReader(s))
if err != nil {
	panic(err)
}
fmt.Println(doc.OutputXML())

Output the below XML:

<?xml version="1.0" encoding="utf-8"?>
<root>
  <expensive>10</expensive>
  <store>
    <bicycle>
      <color>red</color>
      <price>19.95</price>
    </bicycle>
    <book>
      <author>Nigel Rees</author>
      <category>reference</category>
      <id>1</id>
      <price>8.95</price>
      <title>Sayings of the Century</title>
    </book>
    <book>
      <author>Evelyn Waugh</author>
      <category>fiction</category>
      <id>2</id>
      <price>12.99</price>
      <title>Sword of Honour</title>
    </book>
    <book>
      <author>Herman Melville</author>
      <category>fiction</category>
      <id>3</id>
      <isbn>0-553-21311-3</isbn>
      <price>8.99</price>
      <title>Moby Dick</title>
    </book>
    <book>
      <author>J. R. R. Tolkien</author>
      <category>fiction</category>
      <id>4</id>
      <isbn>0-395-19395-8</isbn>
      <price>22.99</price>
      <title>The Lord of the Rings</title>
    </book>
  </store>
</root>

XPath Tests

Query Matched Native Value Types Native Values
//book 1 []interface{} {"book": [{"id":1,... }, {"id":2,... }, {"id":3,... }, {"id":4,... }]}
//book/* 4 [map[string]interface{}] {"id":1,... }, {"id":2,... }, {"id":3,... }, {"id":4,... }
//*[price<12.99] 2 [map[string]interface{}] {"id":1,...}, {"id":3,...}
//book/*/author 4 []string {"author": "Nigel Rees"}, {"author": "Evelyn Waugh"}, {"author": "Herman Melville"}, {"author": "J. R. R. Tolkien"}
//book/*[last()] 1 map[string]interface {} {"id":4,...}
//book/*[2] 1 map[string]interface{} {"id":2,...}
//*[isbn] 2 [map[string]interface{}] {"id":3,"isbn":"0-553-21311-3",...},{"id":4,"isbn":"0-395-19395-8",...}
//*[isbn='0-553-21311-3'] 1 map[string]interface{} {"id":3,"isbn":"0-553-21311-3",...}
//bicycle 1 map[string]interface {} {"bicycle":{"color":...,}}
//bicycle/color[text()='red'] 1 map[string]interface {} {"color":"red"}
//*/category[contains(.,'refer')] 1 string {"category": "reference"}
//price[.=22.99] 1 float64 {"price": 22.99}
//expensive/text() 1 string 10

For more supports XPath feature and function see https://github.com/antchfx/xpath