Contributing to Apache Airflow
0 likes47 views
The document discusses contributing to the Apache Airflow project. It provides an overview of the author's experience contributing to Airflow, including submitting pull requests and participating in the community. The author encourages others to get involved by asking questions, sharing experiences, updating documentation, contributing code, attending or organizing events, and joining the Airflow community on Slack and GitHub.
1 of 50
Download to read offline
Recommended
Developing a gui based design software in
Developing a gui based design software inLaukik Raut
油
In mechanical industry, design process requires more time because it is iterative process and requires
experienced people. We know that there are many CAD packages available in the market for design which demands
modeling skills. It has been observed that many research efforts have been made in the area of design automation like
integration of different CAD software like Creo Parametric, CATIA, SolidWorks with different computer
programming languages like Visual Basic, Java, C++.But it is observed that Visual Basic is having some advantages
over others like it will give us best frame work for product design input base as well as it can be easily interface with
intermediate software like MS-excel which provides an input to other modeling or analysis software and among all
available parametric modeling software Creo is widely used in industries. During the literature review, it is observed
that integration of GUI or tailor made software development using a computer programming language with modeling
software is done till now but further integration with analysis software is not done yet. This integration plays very
important role for design automation of complicated assemblies which will definitely save much time of product design
and development phase.Airflow techtonic template
Airflow techtonic templateSampath Kumar
油
This document provides an overview of Apache Airflow, a workflow automation and scheduling system for data engineering. It discusses key Airflow concepts like DAGs, tasks, hooks and variables. It demonstrates a sample data engineering pipeline using an S3 sensor task and loading data into Elasticsearch. The document also covers Airflow architecture, features, challenges and recommendations for use. It aims to explain how Airflow can be used to build scalable and cost-efficient data pipelines.How Parallelware technology eases HPC software development for POWER systems
How Parallelware technology eases HPC software development for POWER systemsGanesan Narayanasamy
油
Parallelware tools like the Parallelware Trainer and Parallelware Analyzer can help ease HPC software development for POWER systems. The Parallelware Trainer assists with introducing OpenMP and OpenACC directives for parallelization. The Parallelware Analyzer (currently in beta) generates reports to help understand parallelization opportunities in large code bases by analyzing data scoping and memory usage. Future plans include distributing Parallelware tools for POWER systems and certifying them as OpenPOWER Ready to further facilitate HPC software development for these systems.Arnav_Goel_resume_2023.pdf
Arnav_Goel_resume_2023.pdfArnav Goel
油
I create end to end products and work on projects ranging from full stack programming, ML ops and training ML algorithms. I love to see my projects make a difference to the users. Cannot wait for my next adventure !Caleb Vanderpleog Resume and Academic Summary
Caleb Vanderpleog Resume and Academic SummaryCaleb VanderPloeg
油
Caleb Vanderploeg is a mechanical engineer with experience in video editing, mechanical engineering, machining, and tutoring. He graduated from Arizona State University with a 3.9 GPA and a Bachelor's degree in mechanical engineering. His experience includes working as a video editor at WireBuzz LLC, a mechanical engineering intern at GoPro Inc., a machinist at Division Design, Engineer, Machine LLC, and a tutor at Varsity Tutoring. He has extensive experience with CAD software such as SolidWorks and Creo, as well as simulation software including ANSYS and Simulink. His academic projects include designing a wind turbine gearbox and a camera gimbal system. He also has experience performing finite elementmjpaguio-resume
mjpaguio-resumeMark Joseph Paguio
油
This document provides a resume for Mark Joseph F. Paguio, including his contact information, education, certifications, trainings, skills, and 10 years of work experience as a software developer, programmer, and manager for various companies, specializing in languages like Java, PHP, Python, and frameworks like Django and CakePHP. He has experience in roles like project management, software development, database administration, and system administration.MACHINE LEARNING AUTOMATIONS PIPELINE WITH CI/CD
MACHINE LEARNING AUTOMATIONS PIPELINE WITH CI/CDIRJET Journal
油
This document discusses integrating machine learning pipelines with continuous integration and continuous deployment (CI/CD) tools to automate machine learning workflows. It proposes using DevOps tools like Jenkins, Docker, and GitHub to build a CI/CD pipeline for machine learning. The pipeline would include steps for data preprocessing, model training, evaluation, and deployment. Continuous integration would involve regular code updates and testing. Continuous deployment would push trained models to production for monitoring. The goal is to reduce costs and resources needed for machine learning projects through automation with DevOps practices like CI/CD.Mkp resume.docx
Mkp resume.docxMithilesh Kumar
油
Mithilesh Kumar is a software developer with over 2 years of experience developing web applications using ASP.NET, C#, and SQL Server. He has worked on projects including a project tracking system, job portal websites, an online shopping portal for herbal products, and more. Mithilesh has a Master's degree in Computer Applications from IGNOU and skills including C#, C++, Java, JavaScript, jQuery, HTML, XML, ASP.NET, and SQL Server.Resume-Rohit_Vijay_Bapat_December_2016
Resume-Rohit_Vijay_Bapat_December_2016Rohit Bapat
油
Rohit Vijay Bapat's resume summarizes his education and professional experience in software development. He has a MS in Mechanical Engineering from Missouri University of Science and Technology and a BE in Mechanical Engineering from University of Pune. His experience includes roles at Tata Consultancy Services, Mindware Engineering, SigmaTEK Systems, and Vaal Triangle developing CAD/CAM and shopfloor software. He has strong skills in C++, C#, Delphi, and CAD tools like AutoCAD, ProE, and NX.Design of a graphical user interface for design
Design of a graphical user interface for designLaukik Raut
油
In research and development field, many research efforts have been made to save the overall time of product design and
development of any product. As we know that design phase has a lot of potential where overall time can be saved. Hence, design
automation has been the best concept came into picture which involves integration of different software like product design
software developed, modeling software and analysis software. It has been observed that many researchers are taking efforts in the
area of design automation like integration of different tailor made software developed using different computer programming
languages like Visual Basic, Java, C++ with different CAD software like Pro/E, CREO Parametric, CATIA, SolidWorks .But it is
observed that Visual Basic is having some better advantages over others like it will give dot frame work for design of product
input base as well as it can be easily interface with intermediate software like Microsoft excel which provides an input to other
modeling or analysis software and among all available parametric modeling software CREO is widely used in industries because
it has best parameterization quality. In this paper, integration of product design software developed using Visual Basic as
computer programming language and CREO Parametric as modeling software by taking the case study of design of CI Engine
parts has been done to validate the concept. Simulation of CI Engine is added in developed GUI which gives results of pressure,
temperature, volume at each crank angle of crankshaft in the form of graphs and maximum value of pressure and temperature got
are being used for structural and thermal analysis of major components.
IRJET- Lost: The Horror Game
IRJET- Lost: The Horror GameIRJET Journal
油
This document proposes a method to automatically translate C programs into equivalent Java programs. It involves a two phase process - first translating the C program into C++, since the syntax of C and C++ is similar, and then translating the C++ program into Java. An algorithm is implemented that searches the C++ code line by line, identifies equivalent operations in Java like printf/System.out.println, and replaces them to generate the Java code. The method aims to reduce the effort of manual rewriting by producing documentation of the translation process and correspondence between the original C program and resulting Java program. It was tested on some sample C programs that were successfully converted to working Java code.Curriculum Vitae - Eddy Manurung - October2016
Curriculum Vitae - Eddy Manurung - October2016Eddy Manurung
油
Eddy Manurung has over 15 years of experience as a software application consultant and programmer specializing in engineering design. He has strong skills in CATIA V3, V4, V5, V6 and knowledge-based applications for design automation. He has worked on projects for companies like Airbus, Ford, Jaguar, and BAE Systems developing applications and helping with data migration. Currently, he works as a consultant through 3 Rex Limited providing application services for Airbus UK.Resume
ResumeNaveen Mishra
油
Naveen Mishra is a software developer with over 8 years of experience developing web applications using technologies like ASP.NET, C#, AngularJS, and SQL Server. He has worked on projects for companies like Netision Technology, Ampere Software, and Wizard Info Solutions. His responsibilities included developing reports, documentation, and connecting reports to databases. In his current role at Netision Technology he works on projects like a license management solution and email marketing application.project proposal final
project proposal finalArslan Mehmood
油
This document outlines a project to develop an event management planner website. The website will allow event organizers and clients to connect for arranging various event services such as catering, location, photography, and more. It will feature user account creation, event posting, budget setting, bidding, communication tools, and order confirmation. The system will be built as a web application using ASP.NET for the front-end, with a SQL Server database backend. It will follow an iterative development process over 8 months to meet the goals of facilitating event arrangement services between organizers and clients.Resume-Sundar MR
Resume-Sundar MRSundar M R
油
M R Sundar is a Technology Architect at Infosys with over 10 years of experience in software design and development. He is seeking new opportunities and has extensive experience working with technologies like Java, J2EE, Oracle, and various frameworks. His background includes roles as a technical lead, designer, and developer for clients like AT&T, BT, and AOL on projects involving e-commerce platforms, order management systems, and other software.Roopa_software_engineering
Roopa_software_engineeringRoopa Hiremath Chandrasekaraiah
油
The document is a resume for Roopa Hiremath Chandrasekaraiah. She is seeking a full time position in software development and engineering. She has 5 years of experience developing standalone, web, and database applications using languages like Java, Perl, and Python. She is currently an intern at Hewlett-Packard Vertica where she is working on business dashboards using tools like QlikView and Pentaho. She has a Master's in Software Engineering from Arizona State University and a Bachelor's degree in Computer Science and Engineering.Shruti rpa resume_updated (1)
Shruti rpa resume_updated (1)Shruti Shree
油
Hi All,
Do let me know if you have any opportunity in RPA role.
I can join immediately if shortlisted.
Thank you!Shruti rpa resume_updated 
Shruti rpa resume_updated Shruti Shree
油
Hi all,
Do Let me know if you have any opportunity for me for RPA developer role. I can join immediately if shortlisted.
Thank You!Resume
ResumeGurpreet Singh
油
Gurpreet Singh is a software engineer with over 3.8 years of experience developing applications using Microsoft technologies like ASP.NET, C#, SQL Server, and JavaScript. He has a B.Tech in computer science from PTU Jalandhar and has worked on projects involving web development, data extraction, and automation at companies including AMD, Thomson Reuters, and Zcore Technologies. His skills include full stack development, SDLC processes, and technical expertise in .NET, JavaScript, databases, source control, and more.Resume
ResumePhani Chandra Sekhar
油
- The document contains the resume of Phani Chandra Sekhar Avagaddi including his contact details, over 12 years of experience in software development and 1 year as a Project Manager. It lists his technical skills and strengths such as experience in Agile methodologies, .NET technologies, databases, source control tools and various domains. It also provides details of his past work experience, roles and responsibilities, and achievements.Alberto_Cappa_Resume_Apple.pdf
Alberto_Cappa_Resume_Apple.pdfAlbertoCappa1
油
Alberto D. Cappa Cerme単o is a computer science student at the University of Puerto Rico - Mayag端ez Campus with relevant coursework including data structures, algorithms, computer architecture, OOP, programming languages, databases, networks, and machine learning. He has internship experience at Apple and JPMorgan Chase as a devops engineer and software engineer where he developed full stack applications, increased test coverage, and collaborated in agile environments. Currently, he leads a startup project to develop an automated hydroponic system and conducted research using computer vision and TensorFlow. Alberto has experience in leadership positions promoting STEM education.Automatic Graphical Design Generator
Automatic Graphical Design GeneratorIRJET Journal
油
1. The document describes an automatic graphical design generator system that takes a program file as input and generates a graphical design of the program without requiring the user to have knowledge of the program.
2. It aims to reduce the time and effort required to manually create graphical designs by dragging and dropping symbols. The proposed system can generate designs for programs written in languages like Java as long as the program is logically and syntactically correct.
3. Graphical designs provide an easy way to understand complex programs for students and software testers. The automatic generation of designs from code can also assist with reverse engineering programs where the code is available but a design is needed.Computer-Aided Design of Raft Foundation using Excel VBA and FORTRAN
Computer-Aided Design of Raft Foundation using Excel VBA and FORTRANIRJET Journal
油
This document discusses a study that developed computer programs using Excel VBA and FORTRAN to automate the design of raft foundations. The programs were created to reduce the time and errors involved in manual design calculations. The results from the self-developed programs were then compared to results from the commercial software STAAD.Pro. Raft foundation design involves calculating the required thickness and reinforcing steel based on factors like soil properties, column loads, spacing, and design code specifications. The programs were found to accurately perform the design process quickly while following Indian code standards.Biodata_VishweshBehere
Biodata_VishweshBehereVishwesh Behere
油
Vishwesh Behere is seeking a position that allows him to utilize his 8 years of experience in mechanical engineering. He has extensive skills in CAD tools such as Pro-E, CATIA, Autodesk Inventor, and AutoCAD. He has worked as a senior test engineer focusing on product testing, reporting bugs, and authoring documentation. His current role involves testing large collaborative design projects, following agile methodologies, and coordinating with development teams. Prior to his current role, he worked as an application engineer providing CAD support to various clients.Resume2021
Resume2021SaiRohithKoritala
油
A resume highlighting my skills and past experiences. Featuring a versatile skillset and displaying the ability to be malleable to any requirement.RishabhAgarwal
RishabhAgarwalRishabh Agarwal
油
Rishabh Agarwal is seeking a full-time position as a developer to utilize his technical and managerial skills. He has a Master's degree in Computer Engineering from the University of Florida and a Bachelor's in Computer Science from Jaypee University of Engineering and Technology. His work experience includes positions at VMware as a Member of Technical Staff developing automation frameworks and new features for vCloud Director, at Google developing automations for migration, and at AT&T Labs developing test automation tools. He is proficient in languages like Java, C++, Python and technologies like SQL Server, MySQL, Hadoop and has experience with Agile methodologies like Scrum.2D to 3D dynamic modeling of architectural plans in Augmented Reality
2D to 3D dynamic modeling of architectural plans in Augmented RealityIRJET Journal
油
This document describes a research paper that developed an augmented reality application called AR-CHI-TECH. The application takes a 2D floorplan drawing as input, dynamically generates a 3D model from it using image processing and 3D modeling techniques, and then displays the 3D model in augmented reality. This allows users to better visualize architectural plans. The application was created using the Unity3D game engine and Vuforia augmented reality engine. It processes the 2D floorplan using OpenCV to extract structural elements and convert it into a 3D model file. This 3D model is then overlaid onto the original floorplan image using Vuforia when viewed through a mobile device, allowing users to see the floorplan in 3Srikanth resume
Srikanth resumeSrik Maxo
油
Snapshot of professional experience, technical skills and expertise , academic projects and education background
dbt no Airflow: Como melhorar o seu deploy (de forma correta)Tatiana Al-Chueyr
油
Webinar realizado no Jornada de Dados no dia 13 de novembro de 2024.
pt-brIntegrating dbt with Airflow - Overcoming Performance Hurdles
Integrating dbt with Airflow - Overcoming Performance HurdlesTatiana Al-Chueyr
油
Talk given together with Pankaj Koti on 11 September 2024 during Airflow Summit. This video illustrates the performance improvement we obtained:
https://drive.google.com/file/d/1R-v3fIgj5mnJWoqLe-OE0OirybdqRPAY/view?usp=drive_link
The how is discussed in these slides/talk.
More Related Content
Similar to Contributing to Apache Airflow (20)
Resume-Rohit_Vijay_Bapat_December_2016
Resume-Rohit_Vijay_Bapat_December_2016Rohit Bapat
油
Rohit Vijay Bapat's resume summarizes his education and professional experience in software development. He has a MS in Mechanical Engineering from Missouri University of Science and Technology and a BE in Mechanical Engineering from University of Pune. His experience includes roles at Tata Consultancy Services, Mindware Engineering, SigmaTEK Systems, and Vaal Triangle developing CAD/CAM and shopfloor software. He has strong skills in C++, C#, Delphi, and CAD tools like AutoCAD, ProE, and NX.Design of a graphical user interface for design
Design of a graphical user interface for designLaukik Raut
油
In research and development field, many research efforts have been made to save the overall time of product design and
development of any product. As we know that design phase has a lot of potential where overall time can be saved. Hence, design
automation has been the best concept came into picture which involves integration of different software like product design
software developed, modeling software and analysis software. It has been observed that many researchers are taking efforts in the
area of design automation like integration of different tailor made software developed using different computer programming
languages like Visual Basic, Java, C++ with different CAD software like Pro/E, CREO Parametric, CATIA, SolidWorks .But it is
observed that Visual Basic is having some better advantages over others like it will give dot frame work for design of product
input base as well as it can be easily interface with intermediate software like Microsoft excel which provides an input to other
modeling or analysis software and among all available parametric modeling software CREO is widely used in industries because
it has best parameterization quality. In this paper, integration of product design software developed using Visual Basic as
computer programming language and CREO Parametric as modeling software by taking the case study of design of CI Engine
parts has been done to validate the concept. Simulation of CI Engine is added in developed GUI which gives results of pressure,
temperature, volume at each crank angle of crankshaft in the form of graphs and maximum value of pressure and temperature got
are being used for structural and thermal analysis of major components.
IRJET- Lost: The Horror Game
IRJET- Lost: The Horror GameIRJET Journal
油
This document proposes a method to automatically translate C programs into equivalent Java programs. It involves a two phase process - first translating the C program into C++, since the syntax of C and C++ is similar, and then translating the C++ program into Java. An algorithm is implemented that searches the C++ code line by line, identifies equivalent operations in Java like printf/System.out.println, and replaces them to generate the Java code. The method aims to reduce the effort of manual rewriting by producing documentation of the translation process and correspondence between the original C program and resulting Java program. It was tested on some sample C programs that were successfully converted to working Java code.Curriculum Vitae - Eddy Manurung - October2016
Curriculum Vitae - Eddy Manurung - October2016Eddy Manurung
油
Eddy Manurung has over 15 years of experience as a software application consultant and programmer specializing in engineering design. He has strong skills in CATIA V3, V4, V5, V6 and knowledge-based applications for design automation. He has worked on projects for companies like Airbus, Ford, Jaguar, and BAE Systems developing applications and helping with data migration. Currently, he works as a consultant through 3 Rex Limited providing application services for Airbus UK.Resume
ResumeNaveen Mishra
油
Naveen Mishra is a software developer with over 8 years of experience developing web applications using technologies like ASP.NET, C#, AngularJS, and SQL Server. He has worked on projects for companies like Netision Technology, Ampere Software, and Wizard Info Solutions. His responsibilities included developing reports, documentation, and connecting reports to databases. In his current role at Netision Technology he works on projects like a license management solution and email marketing application.project proposal final
project proposal finalArslan Mehmood
油
This document outlines a project to develop an event management planner website. The website will allow event organizers and clients to connect for arranging various event services such as catering, location, photography, and more. It will feature user account creation, event posting, budget setting, bidding, communication tools, and order confirmation. The system will be built as a web application using ASP.NET for the front-end, with a SQL Server database backend. It will follow an iterative development process over 8 months to meet the goals of facilitating event arrangement services between organizers and clients.Resume-Sundar MR
Resume-Sundar MRSundar M R
油
M R Sundar is a Technology Architect at Infosys with over 10 years of experience in software design and development. He is seeking new opportunities and has extensive experience working with technologies like Java, J2EE, Oracle, and various frameworks. His background includes roles as a technical lead, designer, and developer for clients like AT&T, BT, and AOL on projects involving e-commerce platforms, order management systems, and other software.Roopa_software_engineering
Roopa_software_engineeringRoopa Hiremath Chandrasekaraiah
油
The document is a resume for Roopa Hiremath Chandrasekaraiah. She is seeking a full time position in software development and engineering. She has 5 years of experience developing standalone, web, and database applications using languages like Java, Perl, and Python. She is currently an intern at Hewlett-Packard Vertica where she is working on business dashboards using tools like QlikView and Pentaho. She has a Master's in Software Engineering from Arizona State University and a Bachelor's degree in Computer Science and Engineering.Shruti rpa resume_updated (1)
Shruti rpa resume_updated (1)Shruti Shree
油
Hi All,
Do let me know if you have any opportunity in RPA role.
I can join immediately if shortlisted.
Thank you!Shruti rpa resume_updated
Shruti rpa resume_updated Shruti Shree
油
Hi all,
Do Let me know if you have any opportunity for me for RPA developer role. I can join immediately if shortlisted.
Thank You!Resume
ResumeGurpreet Singh
油
Gurpreet Singh is a software engineer with over 3.8 years of experience developing applications using Microsoft technologies like ASP.NET, C#, SQL Server, and JavaScript. He has a B.Tech in computer science from PTU Jalandhar and has worked on projects involving web development, data extraction, and automation at companies including AMD, Thomson Reuters, and Zcore Technologies. His skills include full stack development, SDLC processes, and technical expertise in .NET, JavaScript, databases, source control, and more.Resume
ResumePhani Chandra Sekhar
油
- The document contains the resume of Phani Chandra Sekhar Avagaddi including his contact details, over 12 years of experience in software development and 1 year as a Project Manager. It lists his technical skills and strengths such as experience in Agile methodologies, .NET technologies, databases, source control tools and various domains. It also provides details of his past work experience, roles and responsibilities, and achievements.Alberto_Cappa_Resume_Apple.pdf
Alberto_Cappa_Resume_Apple.pdfAlbertoCappa1
油
Alberto D. Cappa Cerme単o is a computer science student at the University of Puerto Rico - Mayag端ez Campus with relevant coursework including data structures, algorithms, computer architecture, OOP, programming languages, databases, networks, and machine learning. He has internship experience at Apple and JPMorgan Chase as a devops engineer and software engineer where he developed full stack applications, increased test coverage, and collaborated in agile environments. Currently, he leads a startup project to develop an automated hydroponic system and conducted research using computer vision and TensorFlow. Alberto has experience in leadership positions promoting STEM education.Automatic Graphical Design Generator
Automatic Graphical Design GeneratorIRJET Journal
油
1. The document describes an automatic graphical design generator system that takes a program file as input and generates a graphical design of the program without requiring the user to have knowledge of the program.
2. It aims to reduce the time and effort required to manually create graphical designs by dragging and dropping symbols. The proposed system can generate designs for programs written in languages like Java as long as the program is logically and syntactically correct.
3. Graphical designs provide an easy way to understand complex programs for students and software testers. The automatic generation of designs from code can also assist with reverse engineering programs where the code is available but a design is needed.Computer-Aided Design of Raft Foundation using Excel VBA and FORTRAN
Computer-Aided Design of Raft Foundation using Excel VBA and FORTRANIRJET Journal
油
This document discusses a study that developed computer programs using Excel VBA and FORTRAN to automate the design of raft foundations. The programs were created to reduce the time and errors involved in manual design calculations. The results from the self-developed programs were then compared to results from the commercial software STAAD.Pro. Raft foundation design involves calculating the required thickness and reinforcing steel based on factors like soil properties, column loads, spacing, and design code specifications. The programs were found to accurately perform the design process quickly while following Indian code standards.Biodata_VishweshBehere
Biodata_VishweshBehereVishwesh Behere
油
Vishwesh Behere is seeking a position that allows him to utilize his 8 years of experience in mechanical engineering. He has extensive skills in CAD tools such as Pro-E, CATIA, Autodesk Inventor, and AutoCAD. He has worked as a senior test engineer focusing on product testing, reporting bugs, and authoring documentation. His current role involves testing large collaborative design projects, following agile methodologies, and coordinating with development teams. Prior to his current role, he worked as an application engineer providing CAD support to various clients.Resume2021
Resume2021SaiRohithKoritala
油
A resume highlighting my skills and past experiences. Featuring a versatile skillset and displaying the ability to be malleable to any requirement.RishabhAgarwal
RishabhAgarwalRishabh Agarwal
油
Rishabh Agarwal is seeking a full-time position as a developer to utilize his technical and managerial skills. He has a Master's degree in Computer Engineering from the University of Florida and a Bachelor's in Computer Science from Jaypee University of Engineering and Technology. His work experience includes positions at VMware as a Member of Technical Staff developing automation frameworks and new features for vCloud Director, at Google developing automations for migration, and at AT&T Labs developing test automation tools. He is proficient in languages like Java, C++, Python and technologies like SQL Server, MySQL, Hadoop and has experience with Agile methodologies like Scrum.2D to 3D dynamic modeling of architectural plans in Augmented Reality
2D to 3D dynamic modeling of architectural plans in Augmented RealityIRJET Journal
油
This document describes a research paper that developed an augmented reality application called AR-CHI-TECH. The application takes a 2D floorplan drawing as input, dynamically generates a 3D model from it using image processing and 3D modeling techniques, and then displays the 3D model in augmented reality. This allows users to better visualize architectural plans. The application was created using the Unity3D game engine and Vuforia augmented reality engine. It processes the 2D floorplan using OpenCV to extract structural elements and convert it into a 3D model file. This 3D model is then overlaid onto the original floorplan image using Vuforia when viewed through a mobile device, allowing users to see the floorplan in 3Srikanth resume
Srikanth resumeSrik Maxo
油
Snapshot of professional experience, technical skills and expertise , academic projects and education backgroundMore from Tatiana Al-Chueyr (20)
dbt no Airflow: Como melhorar o seu deploy (de forma correta)Tatiana Al-Chueyr
油
Webinar realizado no Jornada de Dados no dia 13 de novembro de 2024.
pt-brIntegrating dbt with Airflow - Overcoming Performance Hurdles
Integrating dbt with Airflow - Overcoming Performance HurdlesTatiana Al-Chueyr
油
Talk given together with Pankaj Koti on 11 September 2024 during Airflow Summit. This video illustrates the performance improvement we obtained:
https://drive.google.com/file/d/1R-v3fIgj5mnJWoqLe-OE0OirybdqRPAY/view?usp=drive_link
The how is discussed in these slides/talk.
Best Practices for Effectively Running dbt in Airflow
Best Practices for Effectively Running dbt in AirflowTatiana Al-Chueyr
油
As a popular open-source library for analytics engineering, dbt is often used in combination with Airflow. Orchestrating and executing dbt models as DAGs ensures an additional layer of control over tasks, observability, and provides a reliable, scalable environment to run dbt models.
This webinar will cover a step-by-step guide to Cosmos, an open source package from Astronomer that helps you easily run your dbt Core projects as Airflow DAGs and Task Groups, all with just a few lines of code. Well walk through:
- Standard ways of running dbt (and when to utilize other methods)
- How Cosmos can be used to run and visualize your dbt projects in Airflow
- Common challenges and how to address them, including performance, dependency conflicts, and more
- How running dbt projects in Airflow helps with cost optimization
Webinar given on 9 July 2024. Recording available in:
https://www.astronomer.io/events/webinars/best-practices-effectively-running-dbt-airflow-video/Integrating ChatGPT with Apache Airflow
Integrating ChatGPT with Apache AirflowTatiana Al-Chueyr
油
Talk given at the London AICamp meet up on the 13 July 2023. It's an introduction on building open-source ChatGPT-like chat bots and some of the considerations to have while training/tuning them using Airflow.From an idea to production: building a recommender for BBC Sounds
From an idea to production: building a recommender for BBC SoundsTatiana Al-Chueyr
油
The document describes the process of developing and productionizing a recommendation engine for BBC Sounds. It discusses:
1) The initial challenge of replacing an outsourced recommendation engine and prototyping a new one using factorization machines. Qualitative user tests showed improved recommendations over the external provider.
2) Productionizing involved using Google Cloud Platform, Apache Airflow for workflows, Apache Beam for efficient data processing, and precomputing recommendations to serve 1500 requests/second with low latency.
3) Initial A/B tests found a 59% increase in interactions and 103% increase for under 35s using the new recommendation engine. Ongoing work includes optimizing costs and API performance.Precomputing recommendations with Apache Beam
Precomputing recommendations with Apache BeamTatiana Al-Chueyr
油
This document summarizes Tatiana Al-Chueyr's presentation on precomputing recommendations for BBC Sounds using Apache Beam. The initial pipeline had high costs due to processing large amounts of data in a single pipeline. Through several iterations, the pipeline was simplified and split into two pipelines - one to precompute recommendations and another to apply business rules. This reduced costs by 82% by using smaller machine types, batching, shared memory, and FlexRS in Apache Dataflow. Splitting the pipeline into minimal interfaces for each task led to more predictable behavior and lower costs.Scaling machine learning to millions of users with Apache Beam
Scaling machine learning to millions of users with Apache BeamTatiana Al-Chueyr
油
Presentation given on the 4th of August 2021 at Beam Summit
Conference website: https://2021.beamsummit.org/
Clearing Airflow Obstructions
Clearing Airflow ObstructionsTatiana Al-Chueyr
油
Presentation given on the 15th July 2021 at the Airflow Summit 2021
Conference website: https://airflowsummit.org/sessions/2021/clearing-airflow-obstructions/
Recording: https://www.crowdcast.io/e/airflowsummit2021/40Scaling machine learning workflows with Apache Beam
Scaling machine learning workflows with Apache BeamTatiana Al-Chueyr
油
Presentation given on the 24th October 2020 at the Nix MultiConf
https://nixmulticonf.com/thinkpython Responsible machine learning at the BBC
Responsible machine learning at the BBCTatiana Al-Chueyr
油
This document summarizes Tatiana Al-Chueyr's presentation on ethical machine learning at the BBC. In 3 sentences:
Tatiana discussed how the BBC uses machine learning to personalize recommendations while upholding editorial values like impartiality. She explained their process for developing recommendation engines, which involves qualitative and quantitative testing as well as integrating legal, editorial and business constraints. Tatiana emphasized that the BBC's goal is to use machine learning to benefit audiences rather than other stakeholders like corporations.Powering machine learning workflows with Apache Airflow and Python
Powering machine learning workflows with Apache Airflow and PythonTatiana Al-Chueyr
油
This document provides an overview of using Apache Airflow to power machine learning workflows with Python. It discusses Airflow concepts like DAGs, operators, relationships and visualizations. It also covers installing Airflow, common issues experienced like debugging and versioning, and using Airflow for machine learning tasks like model building and hyperparameter tuning. Examples of Airflow pipelines for data ingestion and machine learning are demonstrated. The presenter's background and the BBC Datalab team are briefly introduced.Responsible Machine Learning at the BBC
Responsible Machine Learning at the BBCTatiana Al-Chueyr
油
Artificial intelligence breaks into our lives. In the future, everything will probably be clear, but so far, some questions have arisen, and increasingly these issues affect aspects of morality and ethics. Which principles do we need to keep in mind while surfacing machine learning algorithms? How the editorial team affects the day to day development of applications at BBC?
Place: Kharkiv National University of Radio Electronics, Ukraine
When: 17th November 2019.
PyConUK 2018 - Journey from HTTP to gRPC
PyConUK 2018 - Journey from HTTP to gRPCTatiana Al-Chueyr
油
Presented at PyCon UK 2018 (18 September 2018, Cardiff).
The slides are incomplete.
Recording available at:
https://www.youtube.com/watch?v=-weU0Zy4Yd8
Sprint cPython at Globo.comTatiana Al-Chueyr
油
O relat坦rio descreve um sprint realizado pela equipe cPython da Globo.com onde 10 problemas foram investigados, 7 patches foram submetidos e feedback foi recebido para 5 deles. Dois patches foram aceitos e 334 linhas de c坦digo foram modificadas.PythonBrasil[8] - CPython for dummies![PythonBrasil[8] - CPython for dummies](https://cdn.slidesharecdn.com/ss_thumbnails/cpythonfordummies-170610060108-thumbnail.jpg?width=560&fit=bounds)
PythonBrasil[8] - CPython for dummiesTatiana Al-Chueyr
油
This document provides an overview of how to contribute to the cPython source code. It discusses running benchmarks to understand performance differences between loops inside and outside functions. It encourages contributing to improve coding skills and help the open source community. The steps outlined are to clone the cPython source code repository, resolve any dependencies during building, review open issues on bugs.python.org, and work on resolving issues - starting with easier ones. Tips are provided such as commenting when taking ownership of an issue, reproducing bugs before working on them, writing tests for code changes, and updating documentation.QCon SP - recommended for you
QCon SP - recommended for youTatiana Al-Chueyr
油
The document discusses Globo.com's recommendation platform that provides personalized recommendations to users. It uses several big data technologies like Hadoop, Kafka, HBase and Elasticsearch. Recommendations are generated through both pre-computed and real-time approaches. The platform also aims to add semantics to recommendations by linking entities and relationships through techniques like named entity recognition and knowledge graphs. This is expected to improve capabilities like finding, linking and organizing content.Crafting APIs
Crafting APIsTatiana Al-Chueyr
油
The document discusses tips for crafting APIs according to REST principles. It outlines best practices like using nouns for resource identifiers, applying CRUD operations consistently via POST, GET, PUT, DELETE, and including hypermedia links to allow navigating through application states. Other topics covered include API versioning, error handling, and choosing an implementation technology based on performance needs like number of daily accesses. The document emphasizes designing APIs pragmatically with the goal of making them easy for application developers to use.PyConUK 2016 - Writing English Right
PyConUK 2016 - Writing English RightTatiana Al-Chueyr
油
The document presents the challenge of automatically correcting English text to help assess student assignments. It introduces the EFCamDAT dataset containing over 500,000 annotated English essays written by language learners. A number of Python scripts are also introduced that implement heuristics to identify common English mistakes like spelling, capitalization, and article usage in the essays. The scripts analyze the efficiency of the heuristics by calculating precision, recall, and F-score against the teacher annotations in the dataset. The document concludes by discussing feedback received on the project and some advances made since an earlier presentation.
InVesalius: 3D medical imaging softwareTatiana Al-Chueyr
油
O documento descreve o InVesalius, um software p炭blico e gratuito de reconstru巽達o 3D de imagens m辿dicas desenvolvido no Brasil. O InVesalius permite a visualiza巽達o e an叩lise de imagens de TC e resson但ncia magn辿tica, 辿 utilizado por mais de 2.600 usu叩rios em 56 pa鱈ses e tem aplica巽探es em diversas 叩reas m辿dicas como radiologia, neurologia e ortopedia.Automatic English text correction
Automatic English text correctionTatiana Al-Chueyr
油
Presentation about some common mistakes English learners make - and how it is possible to try to identify part of them automatically (spelling, capitalization and article). This presentation was made during PyCon SK on the 12th of March 2016. Many of the results are due to the partnership of the University of Cambridge and Education First.Recently uploaded (20)
Introduction to Forensic Research Digital Forensics
Introduction to Forensic Research Digital ForensicsSaanviMisar
油
Digital Forensics: Analyzing Cyber Crimes & Investigations
This comprehensive guide on Digital Forensics covers key concepts, tools, and methodologies used in investigating cyber crimes. It explores forensic techniques, evidence collection, data recovery, malware analysis, and incident response with real-world applications.
Topics Covered:
Introduction to Digital Forensics
Cybercrime Investigation Process
Digital Evidence & Chain of Custody
Popular Forensic Tools (Autopsy, EnCase, FTK)
Memory & Network Forensics
Challenges in Modern Cyber Investigations
Ideal for students, cybersecurity professionals, and forensic analysts, this resource provides valuable insights into digital investigations.
Introduction to 3D Printing Technology.pptx
Introduction to 3D Printing Technology.pptxpprakash21252
油
Welcome to our presentation on 3D printing technology, where we explore the transformative power of this innovative manufacturing process. Also known as additive manufacturing, 3D printing has been gaining momentum in recent years, and its potential to revolutionize industries is vast.
In this presentation, we delve into the world of 3D printing, discussing its history, principles, and applications. We examine the various types of 3D printing technologies, including Fused Deposition Modeling (FDM), Stereolithography (SLA), and Selective Laser Sintering (SLS). We also explore the advantages and limitations of 3D printing, including its ability to create complex geometries, reduce material waste, and increase product customization.
One of the most significant impacts of 3D printing is its potential to transform industries. We discuss the applications of 3D printing in various sectors, including aerospace, automotive, healthcare, and consumer products. We examine case studies of companies that have successfully implemented 3D printing, such as Boeing, BMW, and Procter & Gamble.
The presentation also explores the future of 3D printing, including emerging trends and technologies. We discuss the potential of 3D printing to disrupt traditional supply chains and create new business models. We also examine the challenges and limitations of 3D printing, including the need for standardization, regulation, and education.
This presentation is ideal for anyone interested in learning about 3D printing technology, including students, researchers, entrepreneurs, and industry professionals. Whether you are looking to gain a basic understanding of 3D printing or seeking to explore its applications in various industries, this presentation is a valuable resource.
Water Industry Process Automation & Control Monthly - April 2025
Water Industry Process Automation & Control Monthly - April 2025Water Industry Process Automation & Control
油
Welcome to the April 2025 edition of WIPAC Monthly, the magazine brought to you by the LInkedIn Group Water Industry Process Automation & Control.
In this month's issue, along with all of the industries news we have a number of great articles for your edification
The first article is my annual piece looking behind the storm overflow numbers that are published each year to go into a bit more depth and look at what the numbers are actually saying.
The second article is a taster of what people will be seeing at the SWAN Annual Conference next month in Berlin and looks at the use of fibre-optic cable for leak detection and how its a technology we should be using more of
The third article, by Rob Stevens, looks at what the options are for the Continuous Water Quality Monitoring that the English Water Companies will be installing over the next year and the need to ensure that we install the right technology from the start.
Hope you enjoy the current edition,
OliverVirtual Power plants-Cleantech-Revolution
Virtual Power plants-Cleantech-RevolutionAshoka Saket
油
VPPs are virtual aggregations of distributed energy resources, such as energy storage, solar panels, and wind turbines, that can be controlled and optimized in real-time to provide grid services.
Software security: Security a Software Issue
Software security: Security a Software IssueDr Sarika Jadhav
油
Software is often designed with security as an afterthought, leading to vulnerabilities that can be exploited by attackers. This has become a critical issue as our reliance on software continues to grow.
Increasing number and sophistication of attacks (CERT vulnerability reports rising).
Software security is the practice of protecting applications from unauthorized access, modification, and destruction.
Secure software development practices.
Executives (E)
Project Managers (M)
Technical Leaders (L)
Unit-03 Cams and Followers in Mechanisms of Machines.pptx
Unit-03 Cams and Followers in Mechanisms of Machines.pptxKirankumar Jagtap
油
Unit-03 Cams and Followers.pptx
Why the Engineering Model is Key to Successful Projects
Why the Engineering Model is Key to Successful ProjectsMaadhu Creatives-Model Making Company
油
In this PDF document, the importance of engineering models in successful project execution is discussed. It explains how these models enhance visualization, planning, and communication. Engineering models help identify potential issues early, reducing risks and costs. Ultimately, they improve collaboration and client satisfaction by providing a clear representation of the project.
NFPA 70B & 70E Changes and Additions Webinar Presented By Fluke
NFPA 70B & 70E Changes and Additions Webinar Presented By FlukeTranscat
油
Join us for this webinar about NFPA 70B & 70E changes and additions. NFPA 70B and NFPA 70E are both essential standards from the National Fire Protection Association (NFPA) that focus on electrical safety in the workplace. Both standards are critical for protecting workers, reducing the risk of electrical accidents, and ensuring compliance with safety regulations in industrial and commercial environments.
Fluke Sales Applications Manager Curt Geeting is presenting on this engaging topic:
Curt has worked for Fluke for 24 years. He currently is the Senior Sales Engineer in the NYC & Philadelphia Metro Markets. In total, Curt has worked 40 years in the industry consisting of 14 years in Test Equipment Distribution, 4+ years in Mfg. Representation, NAED Accreditation, Level 1 Thermographer, Level 1 Vibration Specialist, and Power Quality SME.Airport Components Part1 ppt.pptx-Site layout,RUNWAY,TAXIWAY,TAXILANE
Airport Components Part1 ppt.pptx-Site layout,RUNWAY,TAXIWAY,TAXILANEPriyanka Dange
油
RUNWAY,TAXIWAY,TAXILANETelehealth technology A new horizon in health care
Telehealth technology A new horizon in health careDr INBAMALAR T M
油
Telehealth technology A new horizon in health care, Telemedicine, E-healthDBMS Notes selection projection aggregate
DBMS Notes selection projection aggregateSreedhar Chowdam
油
Selection
Projection
Aggregate functions
Arithmetic & logical operationsRequirements Engineering for Secure Software
Requirements Engineering for Secure SoftwareDr Sarika Jadhav
油
Security requirements are often treated as generic lists of features, neglecting system-specific needs and the attacker's perspective. A systematic approach to security requirements engineering is crucial to avoid this problem.
Requirements engineering defects can cost 10 to 200 times more to correct once the system is operational. Software development takes place in a dynamic environment, causing requirements to constantly change.
UHV Unit - 4 HARMONY IN THE NATURE AND EXISTENCE.pptx
UHV Unit - 4 HARMONY IN THE NATURE AND EXISTENCE.pptxariomthermal2031
油
HARMONY IN THE NATURE AND EXISTENCE Floating Offshore Wind in the Celtic Sea
Floating Offshore Wind in the Celtic Seapermagoveu
油
Floating offshore wind (FLOW) governance arrangements in the Celtic Sea case are changing and innovating in response to different drivers including domestic political priorities (e.g. net-zero, decarbonization, economic growth) and external shocks that emphasize the need for energy security (e.g. the war in Ukraine).
To date, the rules of the game that guide floating wind in the UK have evolved organically rather than being designed with intent, which has created policy incoherence and fragmented governance arrangements. Despite this fragmentation, the UK has a well-established offshore wind sector and is positioning itself to become a global leader in floating wind.
Marine governance arrangements are in a state of flux as new actors, resources, and rules of the game are being introduced to deliver on this aspiration. However, the absence of a clear roadmap to deliver on ambitious floating wind targets by 2030 creates uncertainty for investors, reduces the likelihood that a new floating wind sector will deliver economic and social value to the UK, and risks further misalignment between climate and nature goals.Water Industry Process Automation & Control Monthly - April 2025
Water Industry Process Automation & Control Monthly - April 2025Water Industry Process Automation & Control
油
Contributing to Apache Airflow
- 1. Contributing to Apache Air鍖ow @tati_alchueyr Staff Software Engineer @ Astronomer 1st March 2023 - Woman in Analytics Webinar
- 2. help(airflow) Orchestrates and observes your workflows, so you can focus on defining the steps that will solve business problems
- 3. best flights deals sample problem
- 4. best flights deals Airflow workflow
- 5. best flights deals Airflow workflow code
- 6. airflow.__license__ Apache License 2.0 Download Evaluate Deploy Redistribute Modify
- 10. @tati_alchueyr.__doc__ Staff Software Engineer @ Astronomer improve workflow authors experience Principal Data Engineer @ BBC machine learning at scale Backend Engineer Lead @ Education First language teaching platform Senior Software Engineer @ Globo semantics and web development at scale Software Engineer @ CTI Renato Archer medical image processing 3D image reconstruction Computer Engineer Student @ UNICAMP 2010-2014 2002-2006 2003-2010 2014-2018 2018-2022 2022-now
- 11. December 2018
- 12. request to replace BBC third-party recs engine March 2019
- 13. how we planned to solve the problem March 2019
- 14. how airflow helped July 2019 - August 2020 ingest_user_activity ingest_programme_medatada train_model precompute_recs TODO: Workflows screenshot
- 15. outcomes from Airflow-powered recs workflows July 2019 - August 2020 The recommendations generated with Apache Airflow drove a 59% uplift in the overall user engagement.
- 20. 2020 July 2020 I Airflow Community & Summit Tomek Urbaszek Jarek Potiuk Ash Berlin-Taylor Kaxil Naik Leah Cole
- 22. April 2021
- 25. July 2021
- 26. July 2021
- 29. May 2022
- 33. February 2023
- 36. February 2023
- 41. airflow.__file__
- 42. how you can help
- 43. contribute(airflow) 1. Ask (and answer) questions in Slack or mailing list 2. Share your experience (bugs, ideas, blog posts, talks) 3. Keep the docs up-to-date 4. Contribute with code 5. Attend, speak or host Airflow Meetups and events
- 46. Apache Airflow Community https://airflow.apache.org/community/ https://github.com/apache/airflow
- 48. contribute(airflow) Alone, we can do so little; together, we can do so much Helen Keller