Pandoc 3.1.13 x64

EPUB writer: omit EPUBv3-specific accessibility features on epub2 (#9469). Fixes a regression in 3.1.12.

More fixes for SVG ids with --self-contained (#9467). This generalizes the fix to #9420 so it applies to things like style="fill(url(#..." and should fix problems with SVGs including gradients.

Powerpoint writer: properly handle math in headings and tables (#9465). This ensures that paragraphs containing math are wrapped in a mc:AlternateContent node as required.

Makefile: make validate-epub check v2 output too.

Text.Pandoc.Citeproc: always include an entry-spacing attribute in the Div if the bibliography element contains an entry-spacing attribute (previously we omitted it when it was 0).
Clean up pandoc’s own man pages by regenerating with pandoc 3.1.7.
pandoc-lua-engine: bump lower bound for pandoc.
Depend on texmath 0.12.8.2, fixing binom in typst writer.
JATS reader:
Ignore <processing-meta> element.
Fix conversion of date to ISO 8601 format.
LaTeX template:
Add code allow cite to break across lines
Fix regression with CSL display="block". This restores the line break before the block.
Rewrite CSLReferences environment to avoid depending on enumitem, which plays badly with beamer. Instead we use a regular list environment. Thanks to @jpcirrus for the concept
Restore the pre-3.1.7 format of the CSLReferences environment, which again has two parameters. The first determines whether a hanging indent is used (1 = yes, 0 = no), and the second is the entry line spacing (0 = none).
Add a strut to avoid inconsistencies in spacing.
Remove a break at the end of CSLRightInline to avoid inconsistencies in spacing. It shouldn’t be necessary because the paragraph should extend to the right margin
LaTeX writer:
Fix regression with figure labels (#9045). In 3.1.7, pandoc added two labels to LaTeX figure environments, one with a phantomsection.
Fix default citeproc entry-spacing. According to the CSL manual, the default entry spacing is 1. We were treating it as 0.
HTML writer:
Use the ID prefix in the ID for the footnotes section.
Fix CSL entry-spacing default.

Org reader:
Don’t parse alphabetical lists unless the fancy_lists extension is enabled (#9042).
Allow escaping commas in macro arguments (Amneesh Singh).
JATS reader:
Support for <permissions> metadata (#9037, Julia Diaz). metadata objects with multiple fields are created, matching the structure in JATS.
Correct name of JATS element attrib.
Markdown reader:
Support images with wikilink syntax, e.g. ![[foo|bar]], when one of the wikilinks extension is enabled (#8853).
Allow a citation or reference link to be parsed after a ! (#8254).
Fix dropped ! before nonexistent reference (#9038).
LaTeX writer:
Fix regression in escaping URLs (#9043).
Use cite and bibitem to link up citations, even with citeproc. (#9031). This will give us better accessibility; when tagging is enabled, the citation can be linked to the bibliography entry. This changes some of the details of the layout and the default template. We now make CSLReferences a special enumitem list that will contain bibitems. Internal links inside citations to ids beginning in ref- are creating using cite instead of hyperref.
Use phantomsection and label instead of hypertarget (#9022).
Use hyperref for LaTeX internal links, hyperlink for beamer (since hyperref doesn’t seem to work) (#9022).
Backslash-escape % and # in URLs (#9014).
JATS writer:
Fix placement of ref-list when no title is specified for the reference section (#9017). (In this case we place it in back with an empty title.)
Man writer:
Avoid a .PP right after a section heading (#9020). This is at best a no-op (in groff man and mandoc) and at worst (in some formatters) may create extra whitespace.
We revert the fanciness introduced in #7506, which employs a custom font name V and a macro that makes this act like boldface in a terminal and monospace in other formats. Unfortunately, this code uses a mechanism that is not portable (and does not work in mandoc) (#9020).
Instead of using V for inline code, we simply use CR. Note that f[CR] is emitted instead of plain f[C], because there is no C font in man. (This produces warnings in recent versions of groff, #9020.)
For code blocks, we now use the .EX and .EE macros, together with .IP for spacing and indentation. This gives more standard code that can be better interpreted e.g. by mandoc (#9020).
Man template: don’t emit .hy, regardless of setting of hyphenate variable (#9020).
LaTeX template: special redefinition of st for CJK (#9019). soul’s version raises on error on CJK text.
Use latest skylighting-format-blaze-html (#7248). This works around a longstanding iOS Safari bug that caused long lines to be displayed in a different font size in highlighted code.
Allow skylighting 0.14 (and require it in pandoc core).
Allow text 2.1.

HTML reader: properly calculate RowHeadColumns (#8984). This fixes a bug in the calculation of the number of header columns in table row. It also changes the algorithm for determining the table body’s RowHeadColumns based on the numbers of head columns in each row. Previously we used the max, and #8634 switched to the min, which led to bad results. Now we only set RowHeadColumns to a non-zero value if all rows have the same number of head columns.
OpenDocument writer:
Implement syntax highlighting for inline and block code (#6710).
Support highlighted text in ODT/OpenDocument writers for Span with class mark (#8960). The color can be adjusted by modifying the Highlighted style.
Typst writer: escape // so it doesn’t get interpreted as a comment (#8966).
ChunkedHTML writer: Fix regression including MathJax script (#8967). The fix for #8620 caused the script to be included when the table of contents but not the body text of a page contains math. But it broke the case where the table of contents doesn’t contain math but the page does. This patch fixes the issue.
Text.Pandoc.SelfContained:
Retain attributes in SVG tag when referring to another SVG’s content using <use> (#8969).
Allow units in width and height for SVG. Units are optional but allowed.
Don’t coerce calculated SVG dimensions to Int.
fix calculation of SVG width and height. We were computing width and height from viewBox incorrectly (#8969).
Add clause for SVG to default CSS for HTML (#8969).
Ensure that width and height attributes don’t get specified twice is both the img tag and the svg include them (#8965).
Omit unnecessary attributes xmlns, xmlns:xlink, and version on SVG element (#8965).
Use 20 character rather than 40 character hashes for generated IDs (#8965).
Use pandoc-types 1.23.1. This fixes a regression with toJSONFilter (#8976), which in 1.23.0.1 no longer worked on pure values of type a -> [a].
Use ghc 9.6 for release builds (#8947).
Fix some links in FAQs (Diogo Almiro).

Fix new variant of the vulnerability in CVE-2023-35936. Guilhem Moulin noticed that the fix to CVE-2023-35936 was incomplete. An attacker could get around it by double-encoding the malicious extension to create or override arbitrary files.
--embed-resources: Use inline SVG instead of data uris for SVG images in HTML5 (#8948). Note that SelfContained does not have access to the writer name, so we check for HTML5 by determining whether the document starts with <DOCTYPE! html>. This means that inline SVG won’t be used when generating document fragments.
Fix regression on short boolean arguments (#8956). In 3.1.5 boolean arguments were allowed an optional argument (true|false). This created a regression for uses of fused short arguments, e.g. -somyfile.html, which was equivalent to -s -omyfile.html, but now raised an error because pandoc attempted to parse o as a boolean true or false. This change allows the fused short arguments to be used again. Note that -strue will be interpreted as -s with an argument true, not as -s -t -rue. It is best to use long option names with the optional boolean values, to avoid confusion.
Make --epub-title-page’s argument optional. It takes a boolean argument, and now that all of our boolean flags take such an argument, we can make this one optional for consistency.
Improve errors for illegal output formats. Previously if you did pandoc -s -t bbb, it would give you an error about the missing bbb template instead of saying that bbb is not a supported output format.
Improve errors for incorrect command-line option values (#8879). Always give the name of the relevant argument.
Fix typo on error message for incorrect --preserve-tabs argument. Thanks @fsoedjede
Docx reader: use SVG version of image if present (#7244). Previously the backup PNG was exported even if an SVG was present, but the SVG should be preferred.
Typst reader: fix regression in recognition of display math (#8949). The last release caused all math to be parsed as inline math.
JATS writer: don’t use <code> for inline code (#8889). It is intended for block-level code.
HTML writer: don’t make line blocks sensitive to --wrap (#8952).
RST writer: fix figure handling (#8930, #8871). This fixes a number of regressions from pandoc 2.x. Properly handle caption, alt attribute in figures. No longer treat a paragraph with a single image in it as a figure (we have a dedicated Figure element now).
Docx writer: Copy “mirror margins” property from reference.docx (#8946).
Text.Pandoc.UTF8: Deprecate decodeArg which is now a no-op. This was needed for old base versions which we no longer support.
Use released skylighting, typst.
Allow latest commonmark-extensions. This allows entities in wikilinks.
Switch back to using ghc 9.2 for linux and Windows binary releases (#8947, #8955). With ghc 9.4+, we were getting AVX instructions in the amd64 binary, which aren’t supported on older hardware. For maximum compatibility we switch back to ghc 9.2, which doesn’t cause the problem. (As documented, ghc should not be emiting these instructions, so we aren’t clear on the diagnosis, but the cure has been tested.)
Change Windows release build to use cabal instead of stack.

Add a Lua REPL (Albert Krewinkel). This can be started with pandoc lua -i. It is also possible to instruct a filter to open the REPL at a certain point, for debugging (see pandoc.cli.repl).
Support typst as a --pdf-engine.
Add typst writer (#8713). New module Text.Pandoc.Writers.Typst, exporting writeTypst [API change].
Org reader:
Allow zero width space as an escape character (#8716, Christian Christiansen). Allow the character U+200B to be used as an escape character as described in the Org-mode documentation (https://orgmode.org/manual/Escape-Character.html).
DocBook reader:
Handle “book” for xref references (#8712, Andres Freund) This also adds a test xref to book and part.
Handle <part> (#8712).
HTML reader:
Fix behavior with -native_spans-raw_html (#8711). Previously with this configuration, <span>s were not treated as inline elements at all.
HTML writer:
Avoid duplicate classes (#8705).
Use img element instead of embed for .svg.gz and .png.gz etc. (#8699).
HTML writer footnotes changes (#8695): when --reference-location=section or =block, use an aside element for the notes rather than a section. When --reference-location=section, include the aside element inside the section element, rather than outside. (In slide shows, this option causes footnotes on a slide to be displayed at the bottom of the slide.)
EPUB writer:
Use different structure for epub footnotes (#8676, see #8672, #5583). Many EPUB readers are thrown off by pandoc’s current footnote output. Both the ol and the fact that the footnote backlink is at the end of the note seem to pose problems. With this commit, we now create a list of aside (or div) elements, instead of an ordered list. Each element begins with a note number that is linked back to the note reference. (So, the backlink occurs at the beginning rather than the end.) Thanks to @Porges and @lewer.
Docx writer:
Include abstract title (#8702). Uses localized term for abstract.
Markdown writer:
Use implicit figures if there’s a caption but no alt (#8689, Albert Krewinkel).
Jira reader (Albert Krewinkel):
Add panel title as nested div (#8681).
Require jira-wiki-markup 1.5.1 (#8680). This fixes a bug in the parser that caused text between two exclamation marks to be parsed as an image. The first ! of image markup must now be followed by a non-space character; otherwise, the enclosed text is parsed as normal content.
Ms writer:
Fix handling of Figure (#8660).
ICML writer:
Fix images with data (#8675). The Contents element should be inside Properties.
LaTeX writer:
Add Chinese to Babel languages.
Fix background image in Beamer when there are figure environments (#8671, Mart?n Pozo).
LaTeX template:
Add babelfonts variable to default LaTeX template. This allows specifying certain fonts to be used with certain babel languages. Thanks to Frederik Elwert.
Fix highlight/underline with lualatex (#8707). We need the lua-ul package instead of soul, which doesn’t work with lualatex.
Lua (Albert Krewinkel):
Add pandoc.cli.repl function
Fix json.encode for nested AST elements. Ensures that objects with nested AST elements can be encoded as JSON.
Auto-generate docs for pandoc modules.
Load text module as pandoc.text. This only affects the name in the Lua-internal documentation. It is still possible to load the modules via require 'text', although this is deprecated.
Move docs from module text to pandoc.text The latter is easier to use and more consistent with the other modules.
Keep the Lua stack clean A metatable used during initialization was not properly removed from the stack. Likewise, accessing the CommonState from Lua previously led to the pollution of the Lua stack with a left-over value.
Add function pandoc.format.from_path.
Allow to get the JSON encoding of log messages.
Text.Pandoc.Format: Add new function formatFromFilePaths [API change] (#8710, Albert Krewinkel).
The old Text.Pandoc.App.FormatHeuristics module has been removed.
In --version, use Windows %APPDATA% variable to describe user data dir (#8686, Pablo Rodr?guez).
Text.Pandoc.App.CommandLineOptions: don’t lowercase arg to --from/--read (Albert Krewinkel). This prevented users to use custom writers with uppercase characters in their filenames. Format-normalization, including lower-casing of format identifiers, happens during format parsing.
Documentation:
Add doc/nix.md.
Add doc/extras.md. This was formally in the website repo.
doc/lua-filters.md: improve docs for pandoc.zip.
Factor out make_macos_release.sh from the release candidate workflow. Use cabal instead of stack to build the macos binary.
Modify linux/make_artifacts.sh so it will work on cirrus.
Switch to hslua-2.3
Depend on latest releases of texmath, doclayout.

Fix regression with --print-highlight-style option (#8586).

Add new --chunk-template option (#8581), allowing more control over the filenames in chunked HTML output.

Text.Pandoc.App: Add optChunkTemplate constructor to Opt [API change].

Text.Pandoc.Options: add writerChunkTemplate constructor to WriterOptions [API change].

Text.Pandoc.Chunks: add Data, Typeable, Generic, ToJSON, FromJSON instances for PathTemplate [API change].

Text.Pandoc.Citeproc: Fix bug in metaValueToReference (#8611). This bug caused us to get some repeated content when converting MetaBlock to Inlines.

Textile reader:

Support footnote backlinks (#8585, Stephen Altamirano).
Don’t allow brackets in URLs (#8582).
ODT reader: fix blockquote indent detection (#3437, Daniel Kessler).

LaTeX writer: include short figure/table caption if one is given (Albert Krewinkel). Short captions are used by LaTeX when generating the list of figures or list of tables. Adding a short caption will now overwrite the full caption in these lists.

Powerpoint writer: fix handling of simple figures (#8565, Albert Krewinkel). This ensures that simple figures are displayed in the same way as before the introduction of a dedicated Figure constructor in the AST.

Improve handling of % in bib(la)tex parsing (#8597, #8595).

Use released skylighting 0.13.2.1

INSTALL.md: direct people to cabal install pandoc-cli.

doc/lua-filters.md: document ‘Figure’ type and constructor (Albert Krewinkel). Fix typos (Martin Joerg).

Fix link in manual (#8583, Salim B).