Sysomos Beyond the Numbers - Boolean Query Lesson 2016
â˘Als PPTX, PDF herunterladenâ˘
2 gefällt mirâ˘5,540 views
This presentation goes over lessons in both basic and advanced query writing (boolean queries) for use in Sysomos products. This presentation also goes over some of the new boolean operators available in Sysomos MAP 2.0.
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Was ist angesagt?
Was ist angesagt? (20)
Ăhnlich wie Sysomos Beyond the Numbers - Boolean Query Lesson 2016
Ăhnlich wie Sysomos Beyond the Numbers - Boolean Query Lesson 2016 (20)
Mehr von Sysomos
Mehr von Sysomos (20)
KĂźrzlich hochgeladen
KĂźrzlich hochgeladen (20)
Sysomos Beyond the Numbers - Boolean Query Lesson 2016
- 1. Boolean Queries AndrĂŠs de Rojas Enterprise Customer Success Manager @aderojas
- 2. Housekeeping 2 ⢠Everybody is on mute ⢠Ask questions using the GoToWebinar widget ⢠Weâll answer all questions at the end of the webinar ⢠Feel free to tweet @Sysomos or with the hashtag SysomosBTN
- 3. Agenda ⢠Whatâs âbooleanâ? ⢠Basic Boolean Operators ⢠Advanced Boolean and New Boolean Operators in Sysomos ⢠Questions ⢠Wrap-up and Takeaways 3
- 4. What is âbooleanâ? 4 Boolean Algebra, is a way to describe logical relations in the same way that ordinary algebra describes numeric relations. It was introduced in the 1850s, by the mathematician George Boole. The Force was strong with this oneâŚ
- 5. What is âbooleanâ? 5 ď§ A boolean query is a way to combine words and phrases in order to search through large amounts of data Ěś It makes it easier to find what you are looking for Ěś It saves you time since you wonât have to search through irrelevant results ď§ A well written boolean query in Sysomos will help you find the relevant conversations you care about.
- 6. BASIC BOOLEAN for young padawans 6
- 7. Boolean Basics: simple queries 7 Simple queries are keywords and phrases â Google-like searches. You can search for just one word You can search for a whole phrase lightsaber âprincess leiaâ
- 8. Boolean Basics: main operators 8 AND narrows a search by retrieving mentions where all search terms are present. AND OR AND NOT r2d2 AND c3po r2d2 OR c3po r2d2 AND NOT c3po OR expands a search to retrieve mentions containing at least one search term. AND NOT excludes mentions containing an unwanted term. operators must be capitalized
- 9. Boolean Basics: word variations 9 In order to make sure the search doesnât miss any relevant results, all word variations must be considered (plural-singular, genre, stem and variations, common misspellings, etc.) and included with the OR operator: ď âjediâ OR âjedisâ ď âprinceâ OR âprincessâ ď âjabba the huttâ OR âjaba the huttâ OR âjabba the hutâ OR âjaba the hutâ If there are different words to refer to the same thing, these should be included with the OR operator: ď âandroidâ OR âandroidsâ OR âdroidâ OR âdroidsâ OR ârobotâ OR ârobotsâ
- 10. 10 Boolean Tip: prebuilt boolean filters There are a number of different filter sets you can apply to data in MAP (as an AND or AND NOT statement) available in our support portal: https://support.sysomos.com/ ď Purchase Intent: "I want a" OR "we want a" OR "want to have a" OR "want to buy aâ⌠ď Post Purchase: "just purchased"~2 OR "finished buying"~2 OR "recently purchased"~2 ⌠ď Common Questions: "Who do I" OR "what do I" OR "where do I" OR "when do I" OR "why do I" ⌠ď Customer Service: "Customer Service" OR "Service" OR "cst service"⌠ď Boycott: Boycott OR boycotted OR blacklist OR protest OR protesterâŚ
- 11. 11 Boolean Tip: finding new terms to optimize your query After typing your query, use text analytics features (word cloud, buzzgraph and top hashtags) to find new related terms.
- 12. ADVANCED BOOLEAN for master jedis 12
- 13. Advanced Boolean: parentheses Parentheses must be used to indicate nested queries and the order of operation. ď (âdeath starâ AND (âweak pointsâ OR âhow to destroyâ OR âhow to infiltrateâ)) AND NOT (âbig thermal exhaust portâ OR âsmall thermal exhaust portâ) Inside a given parentheses, only one kind of operator should be used. (âlukeâ AND âobi-wan kenobiâ OR âleiaâ AND âhan soloâ) (âlukeâ AND âobi-wan kenobiâ AND âleiaâ AND âhan soloâ) â â Parentheses are used for nesting different operators to formulate a complex query. ď âdeath starâ AND (âweak pointsâ OR âhow to destroyâ OR âhow to infiltrateâ)
- 14. Advanced Boolean: proximities Proximities: are used to search for documents that contain query terms near each other. It can be looked at as a way to make the AND statement more specific without the restrictions of using a exact phrase. In order to restrict terms to appear within 5 word distance, append ~5 (between 2 and 20). ď âskywalkerâ AND âvaderâ (both terms are present anywhere in the document) ď âskywalker vaderâ~5 (both terms are present in the same phrase ) ď âskywalker vaderâ (only matches the exact phrase)
- 15. Advanced Boolean: twitter operators #: searches for tweets mentioning a specific #hashtag: ď â#ChewbaccaRocksâ from: searches for tweets posted by a specific @handle: ď from:Chewbacca to: searches for tweets posted as a reply to a specific @handle: ď to:Chewbacca @: searches for tweets mentioning by a specific @handle: ď â@Chewbaccaâ âRTâ: although itâs not an operator, added as part of the search term âRTâ searches for retweets of content originally posted by a specific @handle: ď âRT @Chewbaccaâ (Chewbacca OR â@Chewbaccaâ) AND NOT (from:Chewbacca OR âRT Chewbaccaâ) will return tweets about Chewbacca or mentioning his twitter handle, but removes Chewbaccaâs tweets and RT of his content
- 16. Advanced Boolean: wildcards Wildcard ? The ? symbol is replaced with one character at the location it is used. ď§ For example, if you are unsure of how to spell one word, you can use ? to replace a letter Wildcard * The * symbol is replaced with one or more characters at the location it is used. ď§ For example, if you want to search for a noun and all itâs variations, you can use * after the root of the word. âBoba Fet?â will return âBoba fettâ, âboba fetaâ, âboba fetbâ⌠Stormtroop* will return stormtroop, stormtroops, stormtrooper, stormtroopers⌠Wildcards allow to track for multiple terms using a short and simple query.
- 17. Advanced Boolean: unpack twitter links URLs (links) posted on Twitter.com will automatically be shortened to a URL beginning with http://t.co. Unpack Links allows to track URLs that have been shared on Twitter as http://t.co links. Unpacking http://starwars.wikia.com/wiki/Rey will find tweets that have linked to this article. Rrrrrrr-ghgh! t.co/1 Beep beep! t.co/2
- 18. 18 Boolean Tip: combine wildcards with unpack links http://starwars.wikia.com/* will find tweets that have linked to any page in that domain! Specific Twitter content Content from other platforms that has been shared on Twitter ⢠Tweets with images ďź https://pbs.twimg.com/* ⢠Quoted tweets ďź https://twitter.com/twitterhandle/status/* ⢠Twitter Cards ďź https://cards.twitter.com/* ⢠For Instagram ďź https://www.instagram.com/* ⢠For Periscope ďź https://www.periscope.tv* ⢠For Vine ďź https://www.vine.co*
- 19. Advanced Boolean: emojis and emoticons The new way Sysomos indexes content makes more characters searchable All UTF-8 Characters Emoticons Unicode Emojis ? / < > [ ] { } + = ! â % $ & Ď Îž β Đ Đ Ń âŤÚ âŹâŤÚ⏠âŤÜ⏠ŕ ⥠⢠Ž Š Âś Âź § â° â:)â â;)â â:-(â â:-Dâ â#-)â â</3â â*0/*â đ đ đ đĽ đľ đą â đ đŞđ¸ đđ MoreâŚMoreâŚ
- 20. Advanced Boolean: new twitter operators (counts) followerCount:[500 TO 1000] Authors of tweets have to have that number of followers friendCount:[425 TO 5000] Authors of tweets have to follow that number of accounts postCount:[0 TO 1000] Authors of tweets have to have tweeted that many times
- 21. Advanced Boolean: new twitter operators (author tricks) actorName:Mark Searches the profile name (not the Twitter handle) actorVerified:true Authors of tweets have to be verified accounts InfluenceScore:10 Authors of tweets have to be verified accounts
- 22. Advanced Boolean: new twitter operators (device/app) placeName:*android* Tweets have to have been posted from specific apps ⢠Radian6 -Social Media Management ⢠Sprinklr ⢠mPOINTS Mobile Rewards ⢠twitterfeed ⢠Attensity Respond 5 ⢠Twitter for iPhone ⢠Tweetbot for iOS ⢠RoundTeam ⢠Echofon ⢠Twitter for Android ⢠Twitter Web Client ⢠Buffer ⢠TweetAdder v4 ⢠Conversocial ⢠SocialOomph ⢠Sparkcentral.com ⢠Spredfast ⢠Gremln ⢠Facebook ⢠Expiondev ⢠Attensity Respond 6 ⢠Tweetlogix ⢠NewzTwit ⢠PlumeforAndroid ⢠ForceTweet ⢠Hootsuite ⢠Sprout Social ⢠TweetDeck ⢠Cloudhopper ⢠Fenix for Android ⢠Weeder ⢠Win the Customer ⢠TweetCaster for iOS ⢠Foursquare ⢠Flipboard ⢠Twitter for iPad ⢠Twitterrific ⢠SNS Analytics ⢠WordPress.com
- 23. Advanced Boolean: new twitter operators (demographics) placeName:deathstar Searches the name of the location in tweets that have shared geolocation country:ca Country filter (two letter code) province:ny Province filter (two letter code) city:Toronto City filter (full name) lang:ZH Language filter (two letter code) gender:MALE / gender:FEMALE Authors of tweets have to be identified as male or female
- 24. Use Case 24
- 25. Finding influencers around Star Wars, who live in Chicago or Toronto and love R2D2
- 26. Finding influencers around Star Wars, who live in Chicago or Toronto and love R2D2 Boolean Structure (star wars) AND (chicago OR toronto) AND (influence) AND (love (r2d2))
- 27. Finding influencers around Star Wars, who live in Chicago or Toronto and love R2D2 Boolean Structure (star wars) AND (chicago OR toronto) AND (influence) AND (love (r2d2)) Boolean Query (âstarwarsâ OR âStar Warsâ OR â@starwarsâ) AND (city:chicago OR city:toronto) AND (followerCount:[1000 TO 10000000] OR influenceScore:[7 TO 9]) AND (( âI loveâ OR âI likeâ OR âitâs the bestâ OR âI missâ OR âI want moreâ) AND (âr2d2â OR âr2-d2â OR âarturituâ))
- 28. Questions? 28
- 29. Takeaways ⢠Thank George Boole for boolean syntax! ⢠Consider all variations of a word. ⢠Use text analytics to reiterate and improve your queries. ⢠Use the new operators to make your searches more specific. ⢠Have fun! 29
- 30. Thank you! 30
Hinweis der Redaktion
- Hi everyone, and welcome to another edition of the Sysomos Beyond the Numbers Webinar Series! My names is AndrĂŠs de Rojas and Iâll be hosting today session, where weâll talk about Boolean Queries.
- Before we start, here are some houskeeping rules to make sure we can all take the most out of this webinar. Everyboy is on mute, to avoid background noises. So if you have a question please use GoToWebinarâs Question Widget. To make sure we have time to go over everything, weâll answer all the questions at the end of the session. Last but not least, please feel free to tweet about todayâs discussion! You can tag @Sysomos or use the hashtag #SysomosBTN⌠and yes, you can bet weâll be using some of our tools to read your comments ď
- But letâs get started. This is what we will be covering today. First we are going to look into what exactly is boolean to give some cool context to this webinar. Then weâll jump to action and review the basic boolean operators, along with a few tips from the Sysomos team to make magic with your searches. After that weâll get into the best part of todayâs session, looking at advanced boolean and all the new operators that we can use in MAP 2.0 in Sysomos. Before we wrap up weâll of course have some time to answer questions.
- What is boolean? The term comes from a branch of algebra introduced in the 1850s by the mathematician George Boole. Itâs basically a way to describe relationships between concepts, similar to the way ordinary algebra describes relationships between numbers.
- At Sysomos, we use boolean to create very specific searches that return exactly the results that we need for our reports, or that help us understand a very obscure topic. Boolean syntax is therefore at the core of Sysomos, and mastering it will make everyone love you more.
- First of all, when we search in Sysomos we donât necessarily have to use boolean syntax. If our search is simple âlike a Google search, just one word or sentence, then thatâs all we need. Just remember that phrases need quotation marks around them. And I personally always put quotation marks around my search terms, even if itâs just one word, to keep things consistent an easy.
- But the magic of Sysomos is in the boolean, and there are three main operators that basically run the galaxy: AND, OR and AND NOT: AND narrows a search by retrieving mentions where all search terms are present. Itâs a more specific search. OR expands a search to retrieve mentions containing at least one search term. Itâs broadening the search. And lastly the AND NOT excludes mentions containing an unwanted term. Itâs limiting the search.
- We are going to stay with the OR operator for a minute, because itâs actually very important to understand something. When we search for a keyword we normally think of it as a concept, like âjediâ or âpriceâ, but when building the query we have to translate the concept into all the keywords that people use to name that concept. Therefore we have to account for plurals, male and female terminations, misspellings and word variations. The OR operator is what is going to allow us to include all the words in one statement to ensure that we donât miss any mentions. With that we have seen all the boolean basics that you need to start working with Sysomos and finding the conversations that you need, but before we go ahead and take it to the next level I want to go over two good tips for query building.
- The first one is that you are not alone when searching terms. A lot of the searches that you can think of have already been part of other userâs report, and their work makes a great starting point for your custom search. With that in mind we have put together several boolean queries that you can use to build your own. Just go to the support portal and search for âboolean samplesâ, and see what terms we suggest for searches around purchase intent, customer service and a lot more.
- The second tip is on how to grow your list of keywords, how to expand the terms that you are using. And for that we are going to use text analytics tools like the wordcloud or the top hashtags. The workflow would be something like: We build a first query We check the text analytics tools to see what hashtags are people using around that conversations, or which words come up more often We add those terms that are relevant to our search, or filter out whatâs bringing noise (and that we hadnât thought of before) We run our search again, check the results and repeat.
- Let me have a sip of water before we go to the deep side of the boolean pool.
- After working with boolean for a while youâll probably see that sometimes you repeat the same terms over and over again. For example, if we are looking for mentions about how to destroy the Death Star we could do something like "Death Starâ AND âweak pointsâ "Death Starâ AND âhow to destroyâ Or "Death Starâ AND âhow to infiltrateâ And while that would be totally fine, it wouldnât be an efficient way to work with our query. We are wasting precious characters and we are typing the same thing several times, which a) increases our chances to make a mistake, and b) if we have an update, we have to update three things instead of one. Thatâs where parentheses come in, and they are super handy. They work pretty much like High School Math, allowing us to combine operators and apply the same operation to several statements at once. The only thing to keep in mind is that, inside each parentheses, we can only use one of the operators, but for the more complex booleans we can always nest parentheses inside each other to get exactly what we want.
- Another great advanced operator is proximities. When searching long form content, it happens sometimes that the âexact phraseâ match is too restrictive, but using an AND statement we get irrelevant results because a word is mentioned at the beginning of the article and the other word is mentioned 5000 words later, with no real connection. So what proximities allows is to tell our query to search like an AND statement, but restricting the number of words between them. This allows us to restrict the results to those mentions where both terms are present in the same phrase or paragraph, making the results a lot more relevant.
- Thanks to the access that Sysomos gets by being a certified Twitter partner we can also do some very specific searches on this platform. For example, we can search for a specific Hashtag or User, but we can also filter results to see only posts published by a specific account, or as a response to an specific account. And we can even see only retweets to content or retweets to a unique user. All these searches can be stacked and combined with everything else we have seen today, allowing for great influencer research and owned/competitive content analysis. And we are about to see some other new operators that weâll be able to use in MAP 2.0, which is currently in beta. But letâs not get ahead of ourselves, because we have some other cool updates to review first.
- Out of those updates, one of my favorite ones is the Wildcards. Wildcards allow us to be more efficient when writing boolean queries, as we can use them to cover several words while typing a lot less. The ? Wildcard replaces one single character, which makes it perfect for situations where we might not be sure about how to spell a word. The * wildcard, on the other hand, replaces a full string of characters, which means we have a better way to work with word steams and variations. If you speak Spanish, French or any other language that conjugates verbs this is going to be a huge time saver!
- Another really cool feature of MAP 2.0 is that we are able to unpack Twitter links. As you know, when we post a link to Twitter it gets automatically shorten to a t.co URL, as Twitter wants to help us keeps our posts under 140 characters. The problem is that the t.co link is completely random, so there is no way we can see how many people posts links to our pages. Until now, that is. With unpack links we are able to âseeâ whatâs behind the t.co link, and we therefore can check those URLâs.
- Not only that, and this is one of the best tips of this whole webinar, because if we combine the power of wildcards with the power of unpack links we can do a ton of really cool things, like: Find any links to a website (because no one really links to the homepage) Find images posted on Twitter, or quotes, or Twitter Cards âjust combine the basic URL with the wildcard, as shown in the screen, with an AND statement and a user name and find all the pictures they have posted. Find links to other platforms, like Instagra, Periscope or Vine âwhich can be a great way to check if a potential influencer is leveraging other channels.
- Back to the new features, another great update is the ability to search emojis, emoticons and special characters that before were ignored by the system, or treated as spaces. So now we can see if people post tweets with our brand name and a smiley or a sad face, which helps us understand the contexts of mentions that we werenât even able to find before. Question: how to search for an emoji.
- Remember that a few minutes ago we went over the specific operators for Twitter and I mentioned we had a few more coming down the pipe? Now you can see on screen three of them: postCount, friendCount and followerCount. These operators give us more flexibility to filter users by specific datapoints. For example, searching for influencers we might want people who have a certain range of followers or that we can see are very active. Now we can.
- And we can also leverage the user profileâs name (which as you know doesnât always match the handle) and even find only users who have been verified by twitter. Ideal for when we want to find posts by celebrities or recognized personalities. And speaking of personalities, we also have an operator to filter by Sysomosâ Authority score which we can use for one specific score (9) or for a range, with square brackets and for example 7 TO 9.
- In the new MAP we are able to search tweets even by the app that was used to post the tweet! For marketing strategist working very specific target audiences this means that we can filter users who post from Android or iOS devices, or even filter users that use a very specific app.
- And last but not least, our new operators also give us more flexibility to work with demographic filters: gender, country, province, city and language. These filters already existed in Sysomos, but now they can be customized to, for example, apply different filters to different parts of the query.
- Lets create a boolean query from scratch. Imagine our request is to find influencers around Star Wars, who live in Chicago or Toronto and love R2D2. I like to start creating the structure of the boolean, just the skeleton to see what Iâm going to need. Here I would need starwars, the two cities chicago and toronto, a way to define influence, and a boolean definition of love for r2d2. And this is the result. Notice how I have used follower count and influence score to define influencers, and I could have also used the AND statement (number of followers and authority score) to make it more restrictive. And check how I have used boolean syntax to define what love for r2d2 means. Of course looking at text analytics as we have discussed I could probably optimize this search, but this is just an example that I hope inspires you to create more amazing searches!
- Lets create a boolean query from scratch. Imagine our request is to find influencers around Star Wars, who live in Chicago or Toronto and love R2D2. I like to start creating the structure of the boolean, just the skeleton to see what Iâm going to need. Here I would need starwars, the two cities chicago and toronto, a way to define influence, and a boolean definition of love for r2d2. And this is the result. Notice how I have used follower count and influence score to define influencers, and I could have also used the AND statement (number of followers and authority score) to make it more restrictive. And check how I have used boolean syntax to define what love for r2d2 means. Of course looking at text analytics as we have discussed I could probably optimize this search, but this is just an example that I hope inspires you to create more amazing searches!
- Lets create a boolean query from scratch. Imagine our request is to find influencers around Star Wars, who live in Chicago or Toronto and love R2D2. I like to start creating the structure of the boolean, just the skeleton to see what Iâm going to need. Here I would need starwars, the two cities chicago and toronto, a way to define influence, and a boolean definition of love for r2d2. And this is the result. Notice how I have used follower count and influence score to define influencers, and I could have also used the AND statement (number of followers and authority score) to make it more restrictive. And check how I have used boolean syntax to define what love for r2d2 means. Of course looking at text analytics as we have discussed I could probably optimize this search, but this is just an example that I hope inspires you to create more amazing searches!
- Well, now itâs my turn to have a glass of water while we get to your questions. If there is anything you would like to ask please use the questions widget in Go To Webinar.
- Thatâs it for todayâs Beyond the Numbers webinar! Itâs been a blast being here today and I hope you have learnt a few things and had a great time. Enjoy the rest of your day!