pdf-to-markdown/KNOWN_ISSUES.md

# Known Issues

- `IRENE NORTON, ne A ́ DLER` in Sherlock Holmes
- double sided text: right side marked as code (e.g. CC-NC_Leitfaden.pdf)
- upper/lowercas characters wrongly detected (e.g. CC-NC_Leitfaden.pdf)
- footnotes which arnt footnotes (CC_License_Agreement_of_siMPle.pdf) but links (parser issue?)
- alternating page layout => code detection (Life-Of-God-In-Soul-Of-Man.pdf)
- letters are screwed up often (Life-Of-God-In-Soul-Of-Man.pdf)
- no TOC detection (Made-with-cc.pdf)

## Missing or wrong characters

The text which comes of pdfjs looks very erronous sometimes. E.g [Life-Of-God-In-Soul-Of-Man](examples/Life-Of-God-In-Soul-Of-Man.pdf).
The interesting thing is that rendering with pdfjs (online) looks good. So maybe this is just a setup problem !?

## Uncovered TOC variants

- out of order items [Safe-Communication](examples/Safe-Communication.pdf)
- items in wrong lines + numbers are not numbers [Life-Of-God-In-Soul-Of-Man](examples/Life-Of-God-In-Soul-Of-Man.pdf)
- CC-NC_Leitfaden.pdf: un-verified toc entries (and/und/&... etc...)
- Closed-Syllables.pdf: unverified toc entries
- Safe-Communication.pdf: One toc element is one page off (8=>9)
- no page numbers [The-Art-of-Public-Speaking](examples/The-Art-of-Public-Speaking.pdf).
- multiline headlines: [WoodUp](examples/WoodUp.pdf)
- Detecting list of figures (and creating headlines) [Achieving-The-Paris-Climate-Agreement](Achieving-The-Paris-Climate-Agreement.pdf)

# Footnotes

- multiline foot notes (compressed.tracemonkey-pldi-09.pdf)

## Not yet reviewed test PDFS

# Achieving-The-Paris-Climate-Agreement.pdf

- wrong page page mapping ?
- no page numbers removed
- no toc
- romisch numbers are wrong
- subheading under the toc headings should be detected as well (clearly not in the code)
- wrong line orders on page `iv` ? see `This book is an open access publication` & `Additional material to this book`

# Made-with-cc.pdf

- no toc

# Watered-Soul-Blog-Book.pdf

- TOC: character minumum cuts out year
- TOC: stops to early

# Life of God in Soul of man

- Headlines confusion (after the headline the first words of a sentence are big... shouldn't be a headline in this case... looks at all heights in the line)
Add known issues 2021-04-11 09:08:45 +02:00			`# Known Issues`

Improve word boundary detection - sometimes a word is provided with multiple items. E.g: "T his is a sen tence" - use x-axis distance to not put whitespaces in the middle of a word - also tweak the line detection a bit (for Alice) 2024-05-18 07:13:15 +02:00			- `IRENE NORTON, ne A ́ DLER` in Sherlock Holmes
			`- double sided text: right side marked as code (e.g. CC-NC_Leitfaden.pdf)`
			`- upper/lowercas characters wrongly detected (e.g. CC-NC_Leitfaden.pdf)`
			`- footnotes which arnt footnotes (CC_License_Agreement_of_siMPle.pdf) but links (parser issue?)`
			`- alternating page layout => code detection (Life-Of-God-In-Soul-Of-Man.pdf)`
			`- letters are screwed up often (Life-Of-God-In-Soul-Of-Man.pdf)`
			`- no TOC detection (Made-with-cc.pdf)`

Add known issues 2021-04-11 09:08:45 +02:00			`## Missing or wrong characters`

			`The text which comes of pdfjs looks very erronous sometimes. E.g [Life-Of-God-In-Soul-Of-Man](examples/Life-Of-God-In-Soul-Of-Man.pdf).`
			`The interesting thing is that rendering with pdfjs (online) looks good. So maybe this is just a setup problem !?`
Initial TOC detection 2021-04-12 08:09:30 +02:00
			`## Uncovered TOC variants`

			`- out of order items [Safe-Communication](examples/Safe-Communication.pdf)`
			`- items in wrong lines + numbers are not numbers [Life-Of-God-In-Soul-Of-Man](examples/Life-Of-God-In-Soul-Of-Man.pdf)`
Lookup and verify toc links 2021-04-25 14:41:50 +02:00			`- CC-NC_Leitfaden.pdf: un-verified toc entries (and/und/&... etc...)`
			`- Closed-Syllables.pdf: unverified toc entries`
Improve TOC headline detection 2021-04-27 08:24:47 +02:00			`- Safe-Communication.pdf: One toc element is one page off (8=>9)`
Update known issues 2024-03-28 19:03:49 +01:00			`- no page numbers [The-Art-of-Public-Speaking](examples/The-Art-of-Public-Speaking.pdf).`
			`- multiline headlines: [WoodUp](examples/WoodUp.pdf)`
			`- Detecting list of figures (and creating headlines) [Achieving-The-Paris-Climate-Agreement](Achieving-The-Paris-Climate-Agreement.pdf)`
Add 6 more test PDFs 2021-04-18 11:34:11 +02:00
Detect Footnotes - not yet converted in MD - detection should be same as old version 2024-04-09 03:08:26 +02:00			`# Footnotes`

			`- multiline foot notes (compressed.tracemonkey-pldi-09.pdf)`

Reviewing new PDFs 2021-04-18 11:56:42 +02:00			`## Not yet reviewed test PDFS`
Add 6 more test PDFs 2021-04-18 11:34:11 +02:00
Update known issues 2024-03-28 19:03:49 +01:00			`# Achieving-The-Paris-Climate-Agreement.pdf`

			`- wrong page page mapping ?`
			`- no page numbers removed`
			`- no toc`
			`- romisch numbers are wrong`
			`- subheading under the toc headings should be detected as well (clearly not in the code)`
Improve word boundary detection - sometimes a word is provided with multiple items. E.g: "T his is a sen tence" - use x-axis distance to not put whitespaces in the middle of a word - also tweak the line detection a bit (for Alice) 2024-05-18 07:13:15 +02:00			- wrong line orders on page `iv` ? see `This book is an open access publication` & `Additional material to this book`
Update known issues 2024-03-28 19:03:49 +01:00
			`# Made-with-cc.pdf`

			`- no toc`

			`# Watered-Soul-Blog-Book.pdf`

			`- TOC: character minumum cuts out year`
			`- TOC: stops to early`

			`# Life of God in Soul of man`

			`- Headlines confusion (after the headline the first words of a sentence are big... shouldn't be a headline in this case... looks at all heights in the line)`