transcribe

How To Make PDFs Your AI Can Actually Read

Hamel Husain · 8m · transcribed Oct 2026
More from Hamel Husain Business
𝕏 Share ▶ YouTube 📥 PDF 🤖 .md

Section Insights

# 0:00

Introduction to Accessible PDFs

What is the significance of accessible PDFs for individuals with disabilities?

The discussion introduces a new API developed by Data Lab that transforms PDFs into accessible formats for blind individuals. It highlights the challenges faced by screen readers when interpreting standard PDFs, which often results in garbled text and loss of context.

  • Accessible PDFs are crucial for individuals with disabilities to perceive and understand content.
  • Current PDFs often lack proper structure, making them difficult for screen readers to interpret.
  • Human intervention is still recommended for achieving full accessibility.
# 1:37

Challenges with PDF Accessibility

Why are most PDFs inaccessible for blind users?

Many PDFs are either scanned images or lack a proper text layer, making it difficult for screen readers to extract meaningful content. The API developed by Data Lab aims to address these issues at a fraction of the cost of traditional methods.

  • Screen readers struggle with PDFs that are primarily images or poorly structured.
  • Fixing inaccessible PDFs can be prohibitively expensive, often exceeding $100.
  • Data Lab's API offers a cost-effective solution for making PDFs accessible.
# 3:14

Importance of Text Layer in PDFs

What role does the text layer play in PDF accessibility?

The text layer is essential for screen readers to interpret the content correctly. Without it, users may receive nonsensical outputs, making it necessary to meticulously fix PDFs to ensure they are usable.

  • A well-structured text layer allows screen readers to present information in an understandable format.
  • Many PDFs lack a text layer, complicating accessibility efforts.
  • Advanced OCR technology is needed to accurately reconstruct the text layer.
# 4:51

Visual Structure vs. Screen Reader Interpretation

How does visual structure in documents affect screen reader usability?

Visual cues such as bold text, indentation, and layout help convey meaning in documents. When this structure is lost in the text layer, screen readers cannot provide the same context, leading to confusion for users.

  • Visual structure aids in understanding content, which is often lost in poorly formatted PDFs.
  • Screen readers require structured data to interpret documents effectively.
  • Accessibility in education is critical, and the costs of fixing PDFs can be significant.
# 6:28

Real-World Applications of the API

How is Data Lab's API being utilized in educational settings?

The API has been successfully implemented in educational contexts, significantly reducing the time required to make STEM materials accessible for visually impaired students. While it enhances accessibility, human oversight remains necessary for complete compliance.

  • The API streamlines the process of creating accessible educational materials.
  • Human involvement is still essential to ensure full compliance with accessibility standards.
  • The API's efficiency can drastically reduce the time spent on making complex documents accessible.

Transcript

0:00 data lab came up with this accessible PDF API that takes PDFs and turns it into stuff for people who are blind to be able to read because a lot of that is, you know, really not accessible at all. So, let's take a look at the post. Okay, so it's a new processing pipeline for accessible PDFs. I don't think they claim that this is everything you need to be accessible. They still recommend human in the loop, but let's see what we have. What has to be tagged? It's a set of criteria about whether a person with a disability can perceive, operate, and understand a piece of content. Does someone reading with a screen reader, a braille display, or reflow text get the same context in the same order with the same ability to move it around as someone reading a page with your eyes?

0:42 So, this seems really important to me. One thing that that we need to talk about is what the hell do we mean by accessible PDF? Most people aren't blind. They have no experience with accessible PDFs. So, like normally when you use a PDF and you try to get a screen reader to read it to you. Let's say you're blind, it'll just garble everything. It'll like say it in the wrong order. Let's say the PDF has multiple columns or has a table. It'll just say it in the wrong order and it won't make sense to the person hearing it, which is like a huge problem. Most OCR is bad at this accessibility thing.

1:16 And I think that's what they're talking about. >> This first thing they show is a document and the structure of the document, I guess. So headers, paragraphs, lists, formulas. Okay, so alt text is in pixels. Figures are cropped and described based on what they show. So we need to take graphs and furniture and stamps and describe them. Formulas need to be spoken like latte. If a list is broken by page break, that seems page furniture, printed form fields. Vic, who's the founder of data lab, shared this for accessible PDFs. If you're blind, most PDFs are a garbled mess and having one fixed can cost over $100.

1:56 Their API makes them usable for pennies. And he's got this video. Let's take a look. Okay, so there's integrals and formulas on one side and a pages text layer spoken in order. Prove that. And then a screen reader receives it in a little bit more structure. Text and formulas. >> So there's a lot going on here. Can we talk about what happens by default in screen readers with PDFs and like why is it so expensive? Like let's give some background on this.

2:22 >> With a PDF like this integral calculus one here, we'll just use that as an example. That's most of the time just going to be like a scan or an image. It's just like you would expect from like a JPEG or a PNG file where there's really nothing there. Now, sometimes there's like a text layer behind the PDF, but a lot of PDFs don't have it, especially for if you've gotten downloaded a PDF for of a book or it's got a chart or it's got all kinds of stuff. And so, screen reader might get nothing. Or it might use like a really light OCR model to try and like OCR it.

2:54 But if there's no structure, then that's kind of it needs to identify like what is a title and what are all these different things in order to, you know, read them differently. Okay. So like the text layer here if we take this integral calculus and we were to read it using the pages text layer which might be the default 11 period prove that two question mark a a + b square bracket plus asterisk dx. So it's like completely reading that out is completely useless. It's the text layer that is messed up in this PDF. And that's what he's saying. It's like you have to go through and painstakingly fix that especially for complicated things.

3:30 Like you have to go like do some surgery on this. Is that right? >> Yeah. I mean in a lot of cases the text layer doesn't even exist. So you know in this case I don't know maybe you could pass it into an LLM and have it just take the text layer and correct it possibly. But in a lot of cases even that's impossible because there's no text layer at all. >> Yeah. And you have to have some really great OCR to like fix all this stuff.

3:50 like you have to know what's going on and do it accurately. So what is he showing here? What's this screen? >> So this is the same integral calculus but a screen reader gets it in much more structure. So you see text 11 prove that and so you can say well this is just text and pros and you can handle that for how it's going to read that and then it says formula and it gives the whole latte formula. So then that's structured again. So maybe you don't want the formula just read out or maybe you do but you can have special handling for how you want formulas handled and then you have different text layers and formulas and so it breaks it up in a way that you can handle different things.

4:25 It's actually usable and that's one of the big things that is a challenge for screen readers not just for PDFs but like for web as well is that when we look at a page I immediately see there's a lot of like visual information that's not just straight text. For example, I see Vic here. I immediately see that that is the name and that this is like a lighter gray and less important. I can see that like they're on the same line, but it's different pieces of information because there's these like separators and like bold and highlighted and then underneath I see these line breaks. And so even in the something simple like this, I see a lot of structure represented. And if we go back here, it's like same thing in this integral calculus. We see that prove that and then this is indented underneath.

5:11 there's that structure that we know that means it's a formula like at a scan I don't have to read it to know what it is and so we see a lot of the structure same with like page number and then this because this is centered it's very obvious that this is a title and not part of the text >> yes >> and so we visually see all that structure and just getting text and jamming it all together loses a lot of that >> and by the way he's saying having one fixed can cost more than $100 he's referring to the fact that this is a math textbook you take an entire math textbook book fixing everything going through it meticulously because in these environments especially in education you have to be accessible you know there are certain industries and certain situations like you have to be accessible and you should try to be accessible and so these things can be really expensive to get right even with AI and I think that's what he's showing today is like he's tuned a model to like do this really well is that my understanding correct >> yeah absolutely and I mean the cool thing here is that like it sounds like it's this experimental thing but it's Not data lab did this a little bit ago where there's actually Davis County School District is using is bringing STEM to Braille. And so there's a teacher that works with visual impairments in Utah. And he's a certified Braille transcriber and he produces all the STEM materials himself because a lot of times like people come midway through the year or stuff isn't done through the school system. And so this has sped him up from like hours to minutes. And if you look and you compare what this looks like and all this structure that gets here, this is about what's happening here, right? Like you have this and you're putting it into structure. And so this API is accessible, but it's being used in real cases in education.

6:51 >> That's amazing. Okay. So what is he talking about next? He's like, we're not claiming to get 100% compliant. You still need a person just like you said. You might need someone, but maybe instead of hours, you could just take minutes. >> Yeah. I mean, and generally I think when you're using any kind of AI or ML thing, human in the loop is really good, especially if you're doing something where, you know, mistakes can be harmful. Yeah, they give instructions for how to do it. There's a bigger blog post.

7:18 >> You have to wonder also like is this structure, it might be good if you're not blind. If you're trying to feed this to downstream LLM, I don't know, like maybe the structure is better. >> Yeah. Well, I think the structure could be useful cuz a lot of times models are blind, right? they don't see very well unless they pass in an image and a lot of times these models they pass in an image it's like what are they going to do they're going to run OCR on it so they can read it yeah it could be good there data lab also has other models like Shandra that will give it different types of structure like their Shandra model can output HTML or you can use Gemini to put out JSON so depending on what you're doing you might want different types of structure but yeah I mean certainly here a table versus a list versus text versus a footer you might want programmatically handle those in different ways.

Summary

Data Lab has developed an accessible PDF API designed to convert standard PDFs into formats that are usable for individuals with visual impairments. This API aims to address the common issues faced by screen readers, which often misinterpret the structure and content of PDFs, making them difficult to read.

- The API creates a processing pipeline that enhances the accessibility of PDFs, though human oversight is still recommended.
- Accessible PDFs must be tagged correctly to ensure that content is presented in a logical order for screen readers.
- Many existing PDFs lack proper structure, leading to confusion when read aloud by screen readers.
- The API can significantly reduce the cost and time required to make educational materials accessible, from hours to minutes.
- Data Lab's technology has been successfully implemented in educational settings, improving access to STEM materials for visually impaired students.
- While the API enhances accessibility, it does not guarantee 100% compliance, and human review is still necessary for accuracy.
- The structured output from the API can also be beneficial for downstream applications, such as feeding data into language models.
- Data Lab offers various models for different output formats, allowing users to choose the structure that best fits their needs.

Questions Answered

What is the significance of accessible PDFs for individuals with disabilities?

The discussion introduces a new API developed by Data Lab that transforms PDFs into accessible formats for blind individuals. It highlights the challenges faced by screen readers when interpreting standard PDFs, which often results in garbled text and loss of context.

Why are most PDFs inaccessible for blind users?

Many PDFs are either scanned images or lack a proper text layer, making it difficult for screen readers to extract meaningful content. The API developed by Data Lab aims to address these issues at a fraction of the cost of traditional methods.

What role does the text layer play in PDF accessibility?

The text layer is essential for screen readers to interpret the content correctly. Without it, users may receive nonsensical outputs, making it necessary to meticulously fix PDFs to ensure they are usable.

How does visual structure in documents affect screen reader usability?

Visual cues such as bold text, indentation, and layout help convey meaning in documents. When this structure is lost in the text layer, screen readers cannot provide the same context, leading to confusion for users.

How is Data Lab's API being utilized in educational settings?

The API has been successfully implemented in educational contexts, significantly reducing the time required to make STEM materials accessible for visually impaired students. While it enhances accessibility, human oversight remains necessary for complete compliance.

© transcribe · For agents Built with care and craft by Gokul Rajaram