how to read research papers reddit

How to Read Research Papers: A Cheat Sheet for Graduate Students

• August 4, 2022
• PRODUCTIVITY

It is crucial to stay on top of the scientific literature in your field of interest. This will help you shape and guide your experimental plans and keep you informed about what your competitors are working on.

To get the most out of your literature reading time, you need to learn how to read scientific papers efficiently. The problem is that we simply don’t have enough time to read new scientific papers in our results-driven world. 

It takes a great deal of time for researchers to learn how to read research papers. Unfortunately, this skill is rarely taught.

I wasted a lot of time reading unnecessary papers in the past since I didn’t have an appropriate workflow to follow. In particular, I needed a way to determine if a paper would interest me before I read it from start to finish.

So, what’s the solution?

This is where I came across the Three-pass method for reading research papers. 

Here’s what I’ve learned from using the three pass methods and what tweaks I’ve made to my workflow to make it more personalized.

Build time into your schedule 

Before you read anything, you should set aside a set amount of time to read research papers. It will be very hard to read research papers if you do not have a schedule because you will only try to read them for a week or two, and then you will feel frustrated. An organized schedule reduces procrastination significantly.

 For example, I take 30-40 minutes each weekday morning to read a research paper I come across.

After you have determined a time “only” to read research papers, you have to have a proper workflow.

Develop a workflow

For example, I follow a customized version of the popular workflow, the “Three-pass method”. 

When you are beginning, you may follow the method exactly as described, but as you get more experienced, you can make some changes down the road.

Why you shouldn’t read the entire paper at once?

Oftentimes, the papers you think are so important and that you should read every single word are actually worth only 10 minutes of your time.

Unlike reading an article about science in a blog or newspaper, reading research papers is an entirely different experience. In addition to reading the sections in a different order, you must take notes, read them several times, and probably look up other papers for details. 

It may take you a long time to read one paper at first. But that’s okay because you are investing yourself in the process.

However, you’re wasting your time if you don’t have a proper workflow. 

Oftentimes, reading a whole paper might not be necessary to get the specific information you need.

The Three-pass concept

The key idea is to read the paper in up to three passes rather than starting at the beginning and plowing through it. With each pass, you accomplish specific goals and build upon the previous one.

The first pass gives you a general idea of the paper. A second pass will allow you to understand the content of the paper, but not its details. A third pass helps you understand the paper more deeply.

The first pass (Maximum: 10 minutes)

The paper is scanned quickly in the first pass to get an overview. Also, you can decide if any more passes are needed. It should take about five to ten minutes to complete this pass.

Carefully read the title, abstract, and introduction

You should be able to tell from the title what the paper is about. In addition, it is a good idea to look at the authors and their affiliations, which may be valuable for various reasons, such as future reference, employment, guidance, and determining the reliability of the research.

The abstract should provide a high-level overview of the paper. You may ask, What are the main goals of the author(s) and what are the high-level results? There are usually some clues in the abstract about the paper’s purpose. You can think of the abstract as a marketing piece.

As you read the introduction, make sure you only focus on the topic sentences, and you can loosely focus on the other content.

What is a topic sentence?

Topic sentences introduce a paragraph by introducing the one topic that will be the focus of that paragraph. 

The structure of a paragraph should match the organization of a paper. At the paragraph level, the topic sentence gives the paper’s main idea, just as the thesis statement does at the essay level. After that, the rest of the paragraph supports the topic.

In the beginning, I read the whole paragraph, and it took me more than 30 minutes to complete the first pass. By identifying topic sentences, I have revolutionized my reading game, as I am now only reading the summary of the paragraph, saving me a lot of time during the second and third passes.

Read the section and sub-section headings, but ignore everything else 

Regarding methods and discussions, do not attempt to read even topic sentences because you are trying to decide whether this article is useful to you.

Reading the headings and subheadings is the best practice. It allows you to get a feel for the paper without taking up a lot of time.

Read the conclusions

It is standard for good writers to present the foundations of their experiment at the beginning and summarize their findings at the end of their paper.

Therefore, you are well prepared to read and understand the conclusion after reading the abstract and introduction.

Many people overlook the importance of the first pass. In adopting the three-pass method into my workflow, I realized that many papers that I thought had high relevance did not require me to spend more time reading. 

Therefore, after the first pass, I can decide not to read it further, saving me a lot of time.

Glance over the references

You can mentally check off the ones you’ve already read.

As you read through the references, you will better understand what has been studied previously in the field of research.

First pass objectives

At the end of the first pass, you should be able to answer these questions: 

• What is the  category  of this paper? Is it an analytical paper? Is it only an “introductory” paper? (if this is the case, probably, you might not want to read further, but it depends on the information you are after)or is it an argumentative research paper?
• Does the  context  of the paper serve the purpose for what you are looking for? If not, this paper might not be worth passing on to the second stage of this method.
• Does the basic logic of the paper seem to be valid? How do you comment on the  correctness  of the paper?
• What is the main  output  of the paper, or is there output at all?
• Is the paper well written? How do you comment on the  clarity  of the paper?

After the first pass, you should have a good idea whether you want to continue reading the research paper.

Maybe the paper doesn’t interest you, you don’t understand the area enough, or the authors make an incorrect assumption. 

In the first pass, you should be able to identify papers that are not related to your area of research but may be useful someday. 

You can store your paper with relevant tags in your reference manager, as discussed in the previous blog post in the  Bulletproof Literature Management System  series.

This is the third post of the four-part blog series:  The Bulletproof Literature Management System . Follow the links below to read the other posts in the series:

• How to How to find Research Papers
• How to Manage Research Papers
• How to Read Research Papers (You are here)
• How to Organize Research Papers

The second pass (Maximum: 60 minutes)

You are now ready to make a second pass through the paper if you decide it is worth reading more.

You should now begin taking some high-level notes because there will be words and ideas that are unfamiliar to you. 

Most reference managers come with an in-built PDF reader. In this case, taking notes and highlighting notes in the built-in pdf reader is the best practice. This method will prevent you from losing your notes and allow you to revise them easily.

Don’t be discouraged by everything that does not make sense. You can just mark it and move on. It is recommended that you only spend about an hour working on the paper in the second pass. 

In the second pass:

• Start with the abstract, skim through the introduction, and give the methods section a thorough look. 
• Make sure you pay close attention to the figures, diagrams, and other illustrations on the paper. By just looking at the captions of the figures and tables in a well-written paper, you can grasp 90 percent of the information. 
• It is important to pay attention to the overall methodology . There is a lot of detail in the methods section. At this point, you do not need to examine every part. 
• Read the results and discussion sections to better understand the key findings.
• Make sure you mark the relevant references in the paper so you can find them later.

Objectives of the second pass

You should be able to understand the paper’s content. Sometimes, it may be okay if you cannot comprehend some details. However, you should now be able to see the main idea of the paper. Otherwise, it might be better to rest and go through the second pass without entering the third. 

This is a good time to summarize the paper. During your reading, make sure to make notes.

After the second pass, you can: 

• Return to the paper later(If you did not understand the basic idea of the paper)
• Move onto the thirst pass.

The third pass (Maximum: four hours)

You should go to the third stage (the third pass) for a complete understanding of the paper. It may take you a few hours this time to read the paper. However, you may want to avoid reading a single paper for longer than four hours, even at the third pass.

A great deal of attention to detail is required for this pass. Every statement should be challenged, and every assumption should be identified.

By the third pass, you will be able to summarize the paper so that not only do you understand the content, but you can also comment on limitations and potential future developments.

Color coding when reading research papers

Highlighting is one way I help myself learn the material when I read research papers. It is especially helpful to highlight an article when you return to it later. 

Therefore, I use different colors for different segments. To manage my references, I use Zotero. There is an inbuilt PDF reader in Zotero. I use the highlighting colors offered by this software. The most important thing is the concept or phrase I want to color code, not the color itself.

Here is my color coding system.

• Problem statement: Violet
• Questions to ask: Red (I highlight in red where I want additional questions to be asked or if I am unfamiliar with the concept)
• Conclusions: Green (in the discussion section, authors draw conclusions based on their data. I prefer to highlight these in the discussion section rather than in the conclusion section since I can easily locate the evidence there)
• Keywords: Blue
• General highlights and notes: Yellow

Minimize distractions

Even though I’m not a morning person, I forced myself to read papers in the morning just to get rid of distractions. In order to follow through with this process (at least when you are starting out), you must have minimum to no distractions because research papers contain a great deal of highly packed information.

It doesn’t mean you can’t have fun doing it, though. Make a cup of coffee and enjoy reading!

Images courtesy : Online working vector created by storyset – www.freepik.com

Aruna Kumarasiri

Founder at Proactive Grad, Materials Engineer, Researcher, and turned author. In 2019, he started his professional carrier as a materials engineer with the continuation of his research studies. His exposure to both academic and industrial worlds has provided many opportunities for him to give back to young professionals.

Did You Enjoy This?

Then consider getting the ProactiveGrad newsletter. It's a collection of useful ideas, fresh links, and high-spirited shenanigans delivered to your inbox every two weeks.

I accept the Privacy Policy

Hand-picked related articles

Why do graduate students struggle to establish a productive morning routine? And how to handle it?

• March 17, 2024

How to stick to a schedule as a graduate student?

• October 10, 2023

The best note-taking apps for graduate students: How to choose the right note-taking app

• September 20, 2022

Leave a Reply Cancel Reply

Your email address will not be published. Required fields are marked *

Name  *

Email  *

Add Comment  *

Notify me of follow-up comments by email.

Notify me of new posts by email.

Post Comment

How to Read a Research Paper – A Guide to Setting Research Goals, Finding Papers to Read, and More

If you work in a scientific field, you should try to build a deep and unbiased understanding of that field. This not only educates you in the best possible way but also helps you envision the opportunities in your space.

A research paper is often the culmination of a wide range of deep and authentic practices surrounding a topic. When writing a research paper, the author thinks critically about the problem, performs rigorous research, evaluates their processes and sources, organizes their thoughts, and then writes. These genuinely-executed practices make for a good research paper.

If you’re struggling to build a habit of reading papers (like I am) on a regular basis, I’ve tried to break down the whole process. I've talked to researchers in the field, read a bunch of papers and blogs from distinguished researchers, and jotted down some techniques that you can follow.

Let’s start off by understanding what a research paper is and what it is NOT!

What is a Research Paper?

A research paper is a dense and detailed manuscript that compiles a thorough understanding of a problem or topic. It offers a proposed solution and further research along with the conditions under which it was deduced and carried out, the efficacy of the solution and the research performed, and potential loopholes in the study.

A research paper is written not only to provide an exceptional learning opportunity but also to pave the way for further advancements in the field. These papers help other scholars germinate the thought seed that can either lead to a new world of ideas or an innovative method of solving a longstanding problem.

What Research Papers are NOT

There is a common notion that a research paper is a well-informed summary of a problem or topic written by means of other sources.

But you shouldn't mistake it for a book or an opinionated account of an individual’s interpretation of a particular topic.

Why Should You Read Research Papers?

What I find fascinating about reading a good research paper is that you can draw on a profound study of a topic and engage with the community on a new perspective to understand what can be achieved in and around that topic.

I work at the intersection of instructional design and data science. Learning is part of my day-to-day responsibilities. If the source of my education is flawed or inefficient, I’d fail at my job in the long term. This applies to many other jobs in Science with a special focus on research.

There are three important reasons to read a research paper:

Knowledge —  Understanding the problem from the eyes of someone who has probably spent years solving it and has taken care of all the edge cases that you might not think of at the beginning.

Exploration —  Whether you have a pinpointed agenda or not, there is a very high chance that you will stumble upon an edge case or a shortcoming that is worth following up. With persistent efforts over a considerable amount of time, you can learn to use that knowledge to make a living.

Research and review —  One of the main reasons for writing a research paper is to further the development in the field. Researchers read papers to review them for conferences or to do a literature survey of a new field. For example, Yann LeCun’ s paper on integrating domain constraints into backpropagation set the foundation of modern computer vision back in 1989. After decades of research and development work, we have come so far that we're now perfecting problems like object detection and optimizing autonomous vehicles.

Not only that, with the help of the internet, you can extrapolate all of these reasons or benefits onto multiple business models. It can be an innovative state-of-the-art product, an efficient service model, a content creator, or a dream job where you are solving problems that matter to you.

Goals for Reading a Research Paper — What Should You Read About?

The first thing to do is to figure out your motivation for reading the paper. There are two main scenarios that might lead you to read a paper:

Scenario 1 —  You have a well-defined agenda/goal and you are deeply invested in a particular field. For example, you’re an NLP practitioner and you want to learn how GPT-4 has given us a breakthrough in NLP. This is always a nice scenario to be in as it offers clarity.

Scenario 2 —  You want to keep abreast of the developments in a host of areas, say how a new deep learning architecture has helped us solve a 50-year old biological problem of understanding protein structures. This is often the case for beginners or for people who consume their daily dose of news from research papers (yes, they exist!).

If you’re an inquisitive beginner with no starting point in mind, start with scenario 2. Shortlist a few topics you want to read about until you find an area that you find intriguing. This will eventually lead you to scenario 1.

ML Reproducibility Challenge

In addition to these generic goals, if you need an end goal for your habit-building exercise of reading research papers, you should check out the ML reproducibility challenge.

[https://openreview.net/group?id=ML_Reproducibility_Challenge/2020](https://openreview.net/group?id=ML_Reproducibility_Challenge/2020" rel="nofollow noopener)

You’ll find top-class papers from world-class conferences that are worth diving deep into and reproducing the results.

They conduct this challenge twice a year and they have one coming up in Spring 2021. You should study the past three versions of the challenge, and I’ll write a detailed post on what to expect, how to prepare, and so on.

Now you must be wondering – how can you find the right paper to read?

How to Find the Right Paper to Read

In order to get some ideas around this, I reached out to my friend, Anurag Ghosh who is a researcher at Microsoft. Anurag has been working at the crossover of computer vision, machine learning, and systems engineering.

https://anuragxel.github.io/

Here are a few of his tips for getting started:

Always pick an area you're interested in.

Read a few good books or detailed blog posts on that topic and start diving deep by reading the papers referenced in those resources.

Look for seminal papers around that topic. These are papers that report a major breakthrough in the field and offer a new method perspective with a huge potential for subsequent research in that field. Check out papers from the morning paper or C VF - test of time award/Helmholtz prize (if you're interested in computer vision).

Check out books like Computer Vision: Algorithms and Applications by Richard Szeliski and look for the papers referenced there.

Have and build a sense of community. Find people who share similar interests, and join groups/subreddits/discord channels where such activities are promoted.

In addition to these invaluable tips, there are a number of web applications that I’ve shortlisted that help me narrow my search for the right papers to read:

• r/MachineLearning  — there are many researchers, practitioners, and engineers who share their work along with the papers they've found useful in achieving those results.

[https://www.reddit.com/r/MachineLearning/](https://www.reddit.com/r/MachineLearning/" rel="nofollow noopener)

• Arxiv Sanity Preserver  — built by Andrej Karpathy to accelerate research. It is a repository of 142,846 papers from computer science, machine learning, systems, AI, Stats, CV, and so on. It also offers a bunch of filters, powerful search functionality, and a discussion forum to make for a super useful research platform.

• Google Research  — the research teams at Google are working on problems that have an impact on our everyday lives. They share their publications for individuals and teams to learn from, contribute to, and expedite research. They also have a Google AI blog that you can check out.

How to Read a Research Paper

After you have stocked your to-read list, then comes the process of reading these papers. Remember that NOT every paper is useful to read and we need a mechanism that can help us quickly screen papers that are worth reading.

To tackle this challenge, you can use this Three-Pass Approach by S. Keshav . This approach proposes that you read the paper in three passes instead of starting from the beginning and diving in deep until the end.

The three pass approach

The first pass —  is a quick scan to capture a high-level view of the paper. Read the title, abstract, and introduction carefully followed by the headings of the sections and subsections and lastly the conclusion. It should take you no more than 5–10 mins to figure out if you want to move to the second pass.

The second pass —  is a more focused read without checking for the technical proofs. You take down all the crucial notes, underline the key points in the margins. Carefully study the figures, diagrams, and illustrations. Review the graphs, mark relevant unread references for further reading. This helps you understand the background of the paper.

The third pass —  reaching this pass denotes that you’ve found a paper that you want to deeply understand or review. The key to the third pass is to reproduce the results of the paper. Check it for all the assumptions and jot down all the variations in your re-implementation and the original results. Make a note of all the ideas for future analysis. It should take 5–6 hours for beginners and 1–2 hours for experienced readers.

Tools and Software to Keep Track of Your Pipeline of Papers

If you’re sincere about reading research papers, your list of papers will soon grow into an overwhelming stack that is hard to keep track of. Fortunately, we have software that can help us set up a mechanism to manage our research.

Here are a bunch of them that you can use:

• Mendeley [not free]  — you can add papers directly to your library from your browser, import documents, generate references and citations, collaborate with fellow researchers, and access your library from anywhere. This is mostly used by experienced researchers.

https://www.mendeley.com/?interaction_required=true

• Zotero [free & open source] —  Along the same lines as Mendeley but free of cost. You can make use of all the features but with limited storage space.

https://www.zotero.org/

• Notion —  this is great if you are just starting out and want to use something lightweight with the option to organize your papers, jot down notes, and manage everything in one workspace. It might not stand anywhere in comparison with the above tools but I personally feel comfortable using Notion and I have created this board to keep track of my progress for now that you can duplicate:

⚠️ Symptoms of Reading a Research Paper

Reading a research paper can turn out to be frustrating, challenging, and time-consuming especially when you’re a beginner. You might face the following common symptoms:

You might start feeling dumb for not understanding a thing a paper says.

Finding yourself pushing too hard to understand the math behind those proofs.

Beating your head against the wall to wrap it around the number of acronyms used in the paper. Just kidding, you’ll have to look up those acronyms every now and then.

Being stuck on one paragraph for more than an hour.

Here’s a complete list of emotions that you might undergo as explained by Adam Ruben in this article .

Key Takeaways

We should be all set to dive right in. Here’s a quick summary of what we have covered here:

A research paper is an in-depth study that offers an detailed explanation of a topic or problem along with the research process, proofs, explained results, and ideas for future work.

Read research papers to develop a deep understanding of a topic/problem. Then you can either review papers as part of being a researcher, explore the domain and the kind of problems to build a solution or startup around it, or you can simply read them to keep abreast of the developments in your domain of interest.

If you’re a beginner, start with exploration to soon find your path to goal-oriented research.

In order to find good papers to read, you can use websites like arxiv-sanity, google research, and subreddits like r/MachineLearning.

Reading approach — Use the 3-pass method to find a paper.

Keep track of your research, notes, developments by using tools like Zotero/Notion.

This can get overwhelming in no time. Make sure you start off easy and increment your load progressively.

Remember: Art is not a single method or step done over a weekend but a process of accomplishing remarkable results over time.

You can also watch the video on this topic on my YouTube channel :

Feel free to respond to this blog or comment on the video if you have some tips, questions, or thoughts!

If this tutorial was helpful, you should check out my data science and machine learning courses on Wiplane Academy . They are comprehensive yet compact and helps you build a solid foundation of work to showcase.

Read more posts .

If you read this far, thank the author to show them you care. Say Thanks

Learn to code for free. freeCodeCamp's open source curriculum has helped more than 40,000 people get jobs as developers. Get started