Search Engine Evaluator Exam – Crack Leapforce, Appen, Raterlabs & Lionbridge Test

Search Engine Evaluator Exam – Crack Leapforce, Appen, Raterlabs & Lionbridge Test

This blog post may contain affiliate links. Please read the full disclosure here.

Search Engine Evaluator Exam 

There are two different qualification test for two main positions in Leapforce known as Appen Connect now. One test is for Search Engine Evaluator and the other is for Social Media Evaluator. Lionbridge has the same positions and same tests as well. Hence this guide will apply both for Leapforce as well as Lionbridge.

There is one more company that hires only Americans as search engine evaluators. It is known as Raterlabs. So this guide on how to pass search engine evaluator exam will be valid and relevant to Leapforce/Appen Connect, Lionbridge and Raterlabs.

Search Engine Evaluator Test

The qualification test for Search Engine Evaluator is a tough one, very tough in fact. I failed in my first attempt. I passed during my re-take though. Everyday people whine and complain saying that Leapforce didn’t give them enough time. The reality is, they get seven days for the actual test, but they couldn’t crack it. They flunk and they whine about it in forums. It doesn’t mean that you won’t pass the test, if you study religiously. You will. I am not trying to discourage you, all that I am trying to do is to make you aware of the seriousness of this test and the work that you would be ultimately doing.

Exam Strategy

As soon as you get the General Guidelines from Leapforce, read it like hell. You get seven days to finish reading the Guidelines. Click on each and every links given (I mean it) and make your own notes. Take special notice of minute but subtle differences in the examples. Even though the Guidelines is only 147 pages long, due to hundreds of examples with links ( which you have to click and see for yourself if you really want this job), it takes a lot of time to soak in that many information. You get seven days for the actual test. Here is how you should allot the time for each part of the test.:

  • Theoretical Part : Take 1 day aka 24 hours to complete this test. This is an open book Multiple Choice Question type test. Questions are directly taken from the Guidelines. As soon as you hit Submit, you will get an email saying that you have passed the test (or failed the tes). Even though it is an open book test, don’t take it lightly. Many people fail this test.
  • Practical Part I : Allot 2 and half days for this test. This has to be completed in a PC or a Mac or Linux running Chrome or Chromebook. This is a tough exam and hence be very diligent while giving the scores. Your result will be notified immediately as soon as you hit submit button.
  • Practical Part II : Allot 3 and half days for this test. You’ll need a mobile device (not a tablet) and a PC or a Mac or to complete this test. This is the toughest of all the exams (at least it was for me).

Don’t leave anything to the last day:

We all tend to leave everything to the last day and rush through. I am guilty of it and probably you are too. This is not the kind of exam that you can rush through. Please follow the time management strategy detailed above.

Take Notes: 

As you read the guidelines, make sure to go through all the examples and take notes. Take note of the minute but extremely important difference between different kinds of rating examples.

Refer to the guidelines all the time: 

Always go through the guidelines before attempting any questions. Remember this is an open book test. If you are stuck in a question, refer back to the guidelines and make sure that you find that page or article or example that are kind of similar to question that you are attempting.

Control +F or Command+F  is your best friend:

When referring back to the guidelines, always use “Control+F” in Windows or “Command+F” in Mac to look for the keywords contained in the exam.


While appearing for the test (of any part – theory or practical), you don’t have to complete every questions of that part at one sitting. Finish a question ( which may have multiple sub-questions), then hit “submit and stop”, take a break, and restart the test again. You have 90 mins to complete each set of question ( for all parts of the exam) before the question expires.

Social Media Evaluator Test:

The test for Social Media Evaluator is an easy-peasy one. Anyone who reads the guideline diligently will pass the test. The guideline was of 14 pages at the time when I appeared for it in June 2016. There shouldn’t be much changes in the guidelines at the present time too. Anyone who can read and write English should pass this test. It is like a comprehension test based on the contents of the guidelines. But it doesn’t mean that, one shouldn’t study it carefully.

Search Engine Evaluator Exam Free Course

Want a free 5-day course on search engine evaluator exam?

Enter your name and email in the form below 

and get instant access !

Sam Narzary

The author has been an active Google Rater and a location-independent blogger since June 2016. I like anything that frees one from corporate slavery, 9-5 grind, soul-sucking and dream crashing routine.

This Post Has 69 Comments

  1. 1. Appen or Lionbridge for an Indian SEE? In terms of work and pay? Can I do both at the same time?
    2. Why has the pay been reduced at Appen? How does it impact an SEE from a year or two ago when it was $7/hour? Any other options for better pay and work?

    1. 1) If you want higher payrate, go with Lionbridge. If you want more projects go with Appen. Some people work in both the companies (at the same time) in different projects. They risk losing their contract. Lionbridge has a strict policy of not allowing their workers work with other companies.
      2. I don’t know that. Lionbridge pays $6.81/hr, but their hours are kept to 20 hours per week and you can’t work in multiple projects at the same time.

      1. Hello Sam, I have worked with appen and one month ago I applied for a SEE job in lionbridge and I have provided our appen experience there, but my application was rejected by lionbridge. Is it because i have provided the details that i am working in other SEE provider company (Appen) and thus they rejected me because of their policy ? or it is something else that’s why my application rejected

        1. Yes. Exact reason why your application was rejected.

  2. Grettings, sam
    I am trying to take the third exam, however i am having difficulties with my iphone. Do you have any suggestions on how to access it the most simple way.
    J ruano

    1. aaahhh.. I am so sorry for the late reply. If you haven’t taken already, you could just use “” in your phone browser to access send to device tasks of the last part.

      Let me know how it went.

  3. Hi Sam

    I want a free 5-day course on search engine evaluator exam? I got recently failed in lionbridge rater exam.

  4. Hi sam, i am going to apply for the SEE exam, can you please tell how many times can i apply for that test in case i get negative result in first attempt, one of my known is working as SEE for appen can i apply from that system or do i need a separate computer to apply? I mean does Appen remotely monitor the system on which SEE agent is already working??

    1. You may get two chances?

      One of your who is working sorry?

      1. My cousin is working in appen as SEE

        1. Okay, You are going to be need a different system, different IP address and you shouldn’t be living in the same household.

  5. Hi Sam, I applied for raters job and got an email after two weeks. currently I have two options, namely “ch*rry” and “em*rald”. When I click on qualify it says I’ll have one hour to review some guidelines and give a short test. Is the test really hard? I dont want to fail the test.

    1. There are multiple projects inside Appen. The projects you mentioned is not search engine evaluation project. Search engine evaluator job is called as Yukon inside Appen. Look out for Yukon in your all projects tab and apply for it when that project pops up.

      For now, you can try and pass the test for the projects you have.

  6. very informative blog.saw ur answer in quora i think which led me to your portal.
    Have recently passed lionbridge search engine evaluator is the job is it worth it?

      1. Hey sam its almost gonna be a month i passed lionbridge exam.I got all the username and password and even bank account setup.
        I am yet to receive a task.I have mailed them many times they just reply thanks for patience keep logging in tasks may drop anytime as my locale is a new one(punjabi).
        i guess i need to keep patience

        1. Hey Kapil, I have no idea about Punjabi locale unfortunately. Only their support can tell you.

          I guess tasks might be a bit low, considering it is a Punjabi locale.

          I am wondering what is the pay rate for you guys though?

          1. Yeah i did email them they keep saying keep checking regularly tasks may drop anytym.
            Its been a month not a single task.l
            Can only
            6.8$/hour is what they are offering atm.

          2. Okay..I guess you will have to wait and see..

  7. Hello Sam,

    I’m from the Philippines and I applied for the post of Search Engine Evaluator after reading your blog. A few days ago, I received an email from Appen informing me that they will have an upcoming project soon and asked my level of experience in various fields through a survey. Is this related to my application for the SEE post? Also if ever I get selected and pass the exams, can I work remotely even if I’m traveling to the US for vacation?

    1. Hi Mary, I am not too sure what those surveys are for. There shouldn’t be any surveys for SEE.

      At the moment, they are hiring for a lot of projects. Could be some other projects not SEE. Unfortunately, you can’t work these projects from abroad. You will have to inform them that you are going out. Depending on the project, you should be able to take up to 3 weeks off though.

  8. Hey! I had applied to leapforce two years ago. I guess they rejected me but I want to again apply with a better CV which i did but as i have already applied , I guess I cannot apply again. Help on how can I apply again ?

    1. Have you re-applied again like recently? If you did apply again, then don’t re-apply again until its already 6 months.

      You can always apply to Lionbridge though.

      1. Hello Sam ,I’m from India. Are you sure that we can always reply to lionbridge ? With same email id or different email id?. I have terminated from the project before. Thanks

        1. If you have been terminated before, it is very difficult to work with them again. Your name and ID will the same right. So.

          However, you can try for different projects with different email ID, different IP , different devices.

  9. How do you do your taxes? Please make article on it.

    1. We are responsible for our own taxes. Americans get form 1099 from inside the website and they got to do the needful.

Leave a Reply