Sarcasm Annotation The goal of this annotation task is to determine if a tweet is sarcastic (SARCASM) or not sarcastic (NOT_SARCASM) as written by the writer, and assign the corresponding label. While annotating, each tweet is needed to be judged separately. If the context in the tweet is not a clear indication, then NOT_SARCASM label should be used. The annotators are advised to not infer/interpret additional information that is not given in the tweet. Definition: Please find the Wikipedia page of Sarcasm for definition and explanation: http://en.wikipedia.org/wiki/Sarcasm Notes: 1) Sometimes, a tweet can indicate an equally probable situation, one being sarcastic and the other being not sarcastic. Without enough information in the tweet to strongly suggest either, NOT_SARCASM label should apply. 2) If sarcasm is clear from the real world knowledge, then SARCASM should be assigned. 3) If hashtag and the tweet statement express contrasting information indicating the writer is being sarcastic, the tweet should be labeled as SARCASM. 4) Humor/jokes are quite different from sarcasm. Many sarcastic tweets may have intended humor/joke, but the reverse is not always true. Similarly, sarcastic tweets may sometimes seem angry or attacking, but the reverse is not always the case. The focus should always be only on sarcasm, regardless of if it is humorous, attacking or anything else. Note that not all humorous, attacking, teasing tweets are sarcastic. 5) Sometimes, it may happen that a very specific part of a tweet may have opposite indication, but if the main focus/intention of the tweet is not sarcasm, it should not be labeled sarcastic. These are rare, but the annotators need to be careful with these situations. For example: "Stay strong from all the 'tolerant' ones who choose to personally attack you" - it is quite understandable that "tolerant" refers to people who are not really "tolerant", but the focus of the tweet was not sarcasm, rather the call for awareness from a certain type of people. So, the emphasis here is on "Stay strong", which is not sarcastic, and the writer truly wanted people to "Stay strong" from such people. In cases like this, even though the writer is sarcastic in mentioning a type of people, the message itself is not sarcastic, and NOT_SARCASM should be assigned to the corresponding tweet. 6) If there's doubt, and too much inference is required, NOT_SARCASM label should apply. But always consider the surrounding clues and the language of the tweet. For example: "So yeah, I'm really feeling the love tonight.....", the "So yeah", "really" and "....." together provides some hint towards the case that the writer being is sarcastic. SARCASM examples: a) I just love it when I just wanna talk to someone & they don't reply. b) upstairs noise is really helping me to concentrate on my studies c) @USER I'll take a seat outside, weathers beautiful #idiots d) the streetlights in cford are all shining brightly tonight #darkwalkhome #scaredshitless e) yeah, awesome job tonight! #notreally NOT_SARCASM examples: a) There are some classy people here. b) So glad my friends ask me to hangout with them c) Oh how wonderful I feel this morning d) Well, that sounds like sound logic to me! e) i can't wait to wake up tomorrow.