Skip to content

Optimize generating ebooks with page number-based cross-references #4

Description

@joewiz

Ebook generation of 1 volume (frus1964-68v08) takes 60 minutes on @seckroth's 32 GB iMac with 8 GB dedicated to eXist.

Right now, we look up each page-based cross-reference afresh to see what document(s) it might point to and generate the resulting links, and this is an expensive query. There are 9,371 such references in frus1964-68v08. But there are only 1,048 pages in the volume.

So if we switch the code to look up the 1,048 pages first, and use this info as a lookup table, those 9,371 references would be far faster. Hopefully we could see as much as a 9x improvement.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions