Introduce a non-recursive JSON parser
authorAndrew Dunstan <[email protected]>
Mon, 11 Mar 2024 03:10:14 +0000 (23:10 -0400)
committerAndrew Dunstan <[email protected]>
Thu, 4 Apr 2024 10:46:40 +0000 (06:46 -0400)
commit3311ea86edc7a689614bad754e17371865cdc11f
tree7c9d55385afb9b21a8c790a64b1b9ea8eedff90e
parent585df02b445f63167f145685e045e5b6074a5a30
Introduce a non-recursive JSON parser

This parser uses an explicit prediction stack, unlike the present
recursive descent parser where the parser state is represented on the
call stack. This difference makes the new parser suitable for use in
incremental parsing of huge JSON documents that cannot be conveniently
handled piece-wise by the recursive descent parser. One potential use
for this will be in parsing large backup manifests associated with
incremental backups.

Because this parser is somewhat slower than the recursive descent
parser, it  is not replacing that parser, but is an additional parser
available to callers.

For testing purposes, if the build is done with -DFORCE_JSON_PSTACK, all
JSON parsing is done with the non-recursive parser, in which case only
trivial regression differences in error messages should be observed.

Author: Andrew Dunstan
Reviewed-By: Jacob Champion
Discussion: https://postgr.es/m/7b0a51d6-0d9d-7366-3a1a-f74397a02f55@dunslane.net
16 files changed:
src/common/jsonapi.c
src/include/common/jsonapi.h
src/include/pg_config_manual.h
src/test/modules/Makefile
src/test/modules/meson.build
src/test/modules/test_json_parser/Makefile [new file with mode: 0644]
src/test/modules/test_json_parser/README [new file with mode: 0644]
src/test/modules/test_json_parser/meson.build [new file with mode: 0644]
src/test/modules/test_json_parser/t/001_test_json_parser_incremental.pl [new file with mode: 0644]
src/test/modules/test_json_parser/t/002_inline.pl [new file with mode: 0644]
src/test/modules/test_json_parser/t/003_test_semantic.pl [new file with mode: 0644]
src/test/modules/test_json_parser/test_json_parser_incremental.c [new file with mode: 0644]
src/test/modules/test_json_parser/test_json_parser_perf.c [new file with mode: 0644]
src/test/modules/test_json_parser/tiny.json [new file with mode: 0644]
src/test/modules/test_json_parser/tiny.out [new file with mode: 0644]
src/tools/pgindent/typedefs.list