Barcelona Python Meetup - Python June Meetup
Thursday 21 June 2018, 19:00 - 20:00
Avinguda Diagonal, 123, Barcelona, España
# Talks 1) How does that PySpark thing work? And why Arrow makes it faster? by Rubén Berenguel (@berenguel) (English,35 min) Back in ye olde days of Spark, using Python with Spark was an exercise in patience. Data was moving up and down from Python to Scala, being serialised constantly. Leveraging SparkSQL and avoiding UDFs made things better, as well as the constant improvement of the optimisers (Catalyst and Tungsten). But, with Spark 2.3 PySpark has speed up tremendously thanks to the (still experimental) addition of the Arrow serialisers. In this talk we will learn how PySpark has improved its performance in Apache Spark 2.3 by using Apache Arrow. To do this, we will travel through the internals of Spark to find how Python interacts with the Scala core, and some of the internals of Pandas to see how data moves from Python to Scala via Arrow. 2)Frozen Python: satice ice dataloggers by Oriol Sánchez (English,35 min) Project website: https://headingnorthweb.wordpress.com/tag/en-us/ # Access Control - The security access control requires an attendee list. Provide your full name in your profile, otherwise you will be REMOVED from the list. - There are limited seats, please be responsible when signing up. If you can't make it, please free up your seat, so someone else can attend. We'll notice repeat offenders ;-) # More - We need talk proposals! Send yours: http://pybcn.org/call-for-proposals/- Wanna publish a job offer? https://www.meetup.com/python-185/pages/24606847/Job_offers/- Follow @PyBCN for pictures, slides and more: https://twitter.com/pybcn
Publicado por: Betabeers