logo
logo
Sign in

Future of Big Data in Global Markets

avatar
Manohar Parakh
Future of Big Data in Global Markets

LinkedIn is a business-oriented social networking service, which was founded in December 2002 and is mainly serves as professional networking. LinkedIn has been using Big Data to develop following product offerings-

 

1. People You May Know

This feature of LinkedIn reminds the users with the suggestions about other users present at LinkedIn who wish they might probably connect. Most of the LinkedIn data is offline and moves at a very slow pace. Through this feature, “People You May Know”, LinkedIn pre-computes the data by recording 120 Bn relationships per day in a Hadoop MapReduce pipeline, which is running 82 Hadoop jobs that are in need of 16TB of intermediate data. The data infrastructure uses bloom filters for accelerating join operations while running the jobs that provide 10 times better performance. There are 5 test algorithms producing an approximate data of 700 GB of output data, “People You May Know”

2. Skill Endorsements

Skill endorsements is a product used by the recruiters in order to look for the skills and endorsements of a particular candidate. A member can endorse any other member in their network, for a skill displayed on the profile of the endorsed person. Skill endorsement is a deep information extraction data problem. The workflow determines the various skills that exist for a member. The skills are then joined with the profile of a member, social graph, groups and other activity that can help in determining the skills for the person.

3. Jobs You May Be Interested In

LinkedIn uses various Machine Learning and Text Analysis algorithms for showing relevant jobs on a LinkedIn member’s profile.The textual content such as skills, experience and industry are extracted from user’s profile and similar features are extracted from the job listings on LinkedIn. A logistic regression is run for knowing the ranking of relevant jobs for a particular member based on the extracted set of features.

4. News Feed Updates

LinkedIn incorporates data analytics and intelligence for understanding what kind of information the user wishes to read, what subjects he might be interested in and all other types of updates.

Read More>>

collect
0
avatar
Manohar Parakh
guide
Zupyak is the world’s largest content marketing community, with over 400 000 members and 3 million articles. Explore and get your content discovered.
Read more