Big Data Madrid - Big Data Madrid: Mesos Session
martes 18 septiembre 2018, 19:00 - 20:00
Hi Big Data Madrid Lovers!! The next meetup will take place on September 18th and this time we will have the visit of Denis Jannot from Mesosphere. The meetup will take place in La N@ve ( Calle Cifuentes nº5)Author: Denis JannotPosition: Sales Engineer EMEA at Mesosphere Title/abstract:How to build a secure (TLS and Kerberos) Machine Learning Pipeline with Mesosphere DC/OS, Apache NIFI, Kafka, HDFS, Spark and use Jupyterlab to provide a nice user experience. My bio:Denis is a passionate technologist, working on innovative projects leveraging various technologies (Mesos, Kubernetes, Kafka, Spark, ...). Here is the agenda:Mesosphere DC/OS overviewChallenges when trying to build a secure ML pipelineDemo of a Twitter sentiment analysis pipeline with the following high level design:Apache NIFI is used to listen the the Twitter Streaming APIApache NIFI persist the tweets in HDFS and produce them in a Kafka topicA Jupyter notebook is used to create a model using Spark and the tweets stored in HDFSAnother Jupyter notebook is used to apply the model to the tweets consumed from KafkaI think the total duration will be around 1h30, plus probably 30 minutes to socialize We will have time to talk and eat. The talk will start at 19:00h and finish at 21.00h Hope to see you there!!
Publicado por: Betabeers