Stashaway 1
0 likes380 views
This document discusses Stashaway, a tool for organizing digital media by moving files to remote cloud storage. It aims to address issues with local storage becoming expensive and cloud storage becoming popular, requiring data to move from local to remote locations. The document outlines Stashaway's features like uploading files to cloud storage, listing and streaming files remotely, and planned features like tagging and duplicate detection. It provides a development timeline starting with research, an initial coding phase, then beta testing and iterations. The current phase involves choosing a programming language (leaning toward C) and addressing technical challenges like encryption and distribution.
1 of 8
Download to read offline
Recommended
On the Move, Migrations Made Simple
On the Move, Migrations Made SimpleJonathan Perlman
油
Migrations can be a scary thing with so many things to do and think about. Im going to talk about the common tasks to have on your checklist before moving from one host to another. Also, Im going to discuss how to migrate your site from a local install up to a publicly viewable server.10 things you need to know about leaving shared hosting
10 things you need to know about leaving shared hostingJonathan Perlman
油
This document is a presentation by Jonathan Perlman given at WordCamp Montreal 2014. It discusses various hosting options for WordPress websites, including shared hosting, virtual private servers (VPS), and managing servers independently with Linux. It provides recommendations for specific hosting providers and an overview of tasks involved in setting up WordPress on a Linux server like installing software, configuring security, backups, and ongoing maintenance.ProjectTox: Free as in freedom Skype replacement
ProjectTox: Free as in freedom Skype replacementWei-Ning Huang
油
ProjectTox is a decentralized, end-to-end encrypted messaging network that aims to provide a free and secure alternative to Skype. It uses a distributed hash table and end-to-end encryption to allow communication without a centralized server. The core supports text, file transfers, group chat, and audio/video calls between two users. Several clients have been developed including Toxic for the command line and PyTox which provides full audio/video support through Python bindings. The developer demonstrated PyTox's new audio/video functionality and encouraged participants to join the project on GitHub or its wiki.Docker and Running multiple versions of PHP @ CareerZoo Dublin
Docker and Running multiple versions of PHP @ CareerZoo Dublinrjsmelo
油
Ricardo Melo gives a presentation on Docker containers. The presentation covers Docker, Docker Hub for hosting container images, Docker Compose for running multiple services, and demonstrates using Docker to run different PHP versions. It concludes with taking questions and information on job opportunities at Smartbox.Mp26 : Tachyon, sloppiness is bliss
Mp26 : Tachyon, sloppiness is blissMontreal Python
油
This document describes Tachyon, an offensive tool for penetration testers to discover hidden files and folders on web servers through intelligent scanning. It utilizes a plugin architecture and multi-threading to quickly scan sites. The document outlines Tachyon's features like Tor support, path and file databases, plugin system, and false positive detection methods. It notes limitations and plans for future improvements like faster speeds, cleaner output, and a plugin documentation system.PHP QA Tools
PHP QA Toolsrjsmelo
油
Doing Quality Assurance in PHP projects sometimes looks like a dark art! Picking the right tools, making all tools work together, analysing your code and even then deliver all the required features of the software project can be quite challenging.
This talks aims to help lowering the entry barrier for doing QA on your project, sharing the experience, knowledge and some tricks that brings QA back from the dark arts to the every day of a PHP programmer.
We will review tools like Jenkins, PHPUnit, phpcs, pdepend, phpcpd, etc and how we can chain them together to make sure we are building a great software.Docker and .NET Core - Best Friends Forever - Michael Newton - Codemotion Rom...
Docker and .NET Core - Best Friends Forever - Michael Newton - Codemotion Rom...Codemotion
油
The .NET languages have always been top notch in design, with a wide ranging standard library and support for all your enterprise needs. But for those of us with experience in the world outside Windows, the operational side of things was unbelievably painful. Now, with .NET Core that's starting to change. Here we'll work through the process of taking a .NET library and building a CI pipeline from reproducible container based builds through to minimal deployment artifacts.Go Programming Language by Google
Go Programming Language by GoogleUttam Gandhi
油
Go is a programming language created by Google that aims to be a simple, efficient, and concurrent language. The document provides an overview of the history and features of Go, including its support for garbage collection, concurrency, and ease of programming. Examples are given demonstrating how to write Go code, use interfaces and channels for concurrency, and connect to MongoDB. The document also lists several companies that use Go in production applications.From NodeJS to Rust
From NodeJS to RustBastian Gruber
油
The document discusses choosing Rust over NodeJS for software development. It provides an overview of the speaker's background and experience with Rust. Some key differences between NodeJS and Rust mentioned are that Rust has no need for TypeScript or additional tooling, ships binaries, and allows for more performant code through compiler checks. The document also outlines steps for getting started with Rust, including recommended books and practice projects. Popular Rust libraries for web development are also listed.A Shallow Survey of Alternative Languages on the JVM
A Shallow Survey of Alternative Languages on the JVMCharles Anderson
油
This document surveys alternative languages that run on the Java Virtual Machine (JVM), including ported languages like JRuby and new languages like Groovy and Scala. It discusses why developers use these languages, noting they provide access to powerful Java platforms and libraries while allowing programming in more modern languages. Issues like performance and compatibility challenges are also outlined. Examples of code in several languages are provided.Golang
GolangMichael Blake
油
Go is an open source programming language designed for building simple, fast, and reliable software. It is concurrent and garbage collected, with tools to manage dependencies, support version control, and test code. The document discusses Go's philosophy, tools, web development capabilities using net/http, concurrency with goroutines, exception handling without exceptions, popular frameworks, organizations using Go, and references for learning more.Intro to GO (Bangkok Launchpad 2014)
Intro to GO (Bangkok Launchpad 2014)Matthew Campbell
油
The document introduces GO and discusses why a consulting firm chose to build an instant messaging server using GO. It provides an overview of GO, including that it is a lightweight programming language developed by Google that uses garbage collection and makes concurrency easy using goroutines and channels. The document also provides code samples and discusses getting started with GO development.Distributed locks in Ruby - Correctness vs Efficiency - Knapsack Pro case stu...
Distributed locks in Ruby - Correctness vs Efficiency - Knapsack Pro case stu...Artur Trzop
油
This document discusses using distributed locks to synchronize access to shared resources in distributed applications. It provides examples of when distributed locks are needed to prevent data corruption or loss from concurrent requests. The document recommends using proven distributed lock libraries like redis-semaphore and redlock-rb to implement distributed locks instead of recreating the logic. Tips are given on testing for concurrency issues and choosing correctness over efficiency with locks.Chromium OS Introduction
Chromium OS IntroductionWei-Ning Huang
油
Code & Beer #12
Chromium OS Introduction
https://code-beer.hackpad.com/WtAf9qA1qOx#:h=#12-Chromium-OS-IntroductionopenSUSE tools on Debian
openSUSE tools on DebianHideki Yamane
油
openSUSE.Asia Summit 2017 talk slide
https://events.opensuse.org/conference/summitasia17/program/proposal/1512A Recovering Java Developer Learns to Go
A Recovering Java Developer Learns to GoMatt Stine
油
As presented at OSCON 2014.
The Go programming language has emerged as a favorite tool of DevOps and cloud practitioners alike. In many ways, Go is more famous for what it doesnt include than what it does, and co-author Rob Pike has said that Go represents a less is more approach to language design.
The Cloud Foundry engineering teams have steadily increased their use of Go for building components, starting with the Router, and progressing through Loggregator, the CLI, and more recently the Health Manager. As a recovering-Java-developer-turned-DevOps-junkie focused on helping our customers and community succeed with Cloud Foundry, it became very clear to me that I needed to add Go to my knowledge portfolio.
This talk will introduce Go and its distinctives to Java developers looking to add Go to their toolkits. Well cover Go vs. Java in terms of:
* type systems
* modularity
* programming idioms
* object-oriented constructs
* concurrencyHello android
Hello androidDENNIS JUNG
油
This document provides an overview of the Android architecture and tools needed to build a basic "Hello World" Android application. It describes the core Android components like activities, services, and the runtime environment. It also outlines how to set up Android Studio, create a simple project with an activity and layout, add a button to trigger an intent for inter-activity communication, and handle the activity lifecycle.KubeCon EU 2019 - P2P Docker Image Distribution in Hybrid Cloud Environment w...
KubeCon EU 2019 - P2P Docker Image Distribution in Hybrid Cloud Environment w...Yiran Wang
油
Docker image is a foundational building block of container based infrastructure, but distributing high volume of docker images in a multi-zone, hybrid cloud system has been a scaling problem for many.
In this talk, we will walk through different approaches we investigated for distributing docker images and introduce Ubers own solution, Kraken, a P2P docker registry loosely based on BitTorrent protocol, and capable of distributing terabytes of images within seconds.
This talk will cover:
- Image distribution solutions and their characteristics
- Whether you need a p2p solution
- Architecture, performance and security features of Kraken
- How to deploy Kraken in a Kubernetes cluster10 reasons to be excited about go
10 reasons to be excited about goDvir Volk
油
Go is an exciting new programming language developed at Google that focuses on high performance and easing the developer experience. It has many advantages over other languages like C++ such as having a simple, quick to learn syntax, extremely fast compiler and execution speeds, powerful standard library, easy concurrency with goroutines and channels, and implicit interfaces. While still missing some features like a full IDE, Go shows great promise for building scalable server side applications and performing data processing.Command line git
Command line gitManos Emmanouilidis
油
This document provides instructions and explanations for using Git from the command line. It discusses installing Git and related tools, setting up SSH keys, and configuring aliases. The document then explains the basic Git workflow of committing changes locally and pushing them to a central repository. Key Git concepts covered include branches, tags, refs, remotes, and Merkle trees for tracking history. Tips are provided such as committing frequently and using the reflog to recover from mistakes. Resources for learning more about Git are listed at the end.Messing with binary formats
Messing with binary formatsAnge Albertini
油
a 44CON 2013 presentation
slides downloadable (including inception binary) at http://mix.corkami.comOshw documentation project video 1 - lars zimmermann
Oshw documentation project video 1 - lars zimmermannLars Zimmermann
油
This document discusses assumptions for open sourcing hardware. It lists four main assumptions: 1) Platform independence using metaphors of Libre Office (available everywhere) and JSON (machine readable), 2) Complexity arising from simplicity, 3) Producing information simultaneously with physical things, and 4) Implementing circles of participation with inputs, processes, and outputs. It also provides credits and licenses for various images included.A tale of two(many) proxies
A tale of two(many) proxiesMohan Dutt
油
We often find ourselves confounded by the fundamentals when it comes to implementing our own proxy. A Proxy can solve much more than a basic use case, and I will be elaborating on the various scenarios where proxies come in handy and will be speaking about the richness of Golangs httputil package.Strategies for developing and deploying your embedded applications and images
Strategies for developing and deploying your embedded applications and imagesMender.io
油
We will delve into multiple strategies you can use for developing and deploying code to embedded devices. We will compare and contrast the following:
Lightweight package managers: ipkg/opkg
Desktop package managers: rpm/deb
Configuration Management Tools
Smart Package Manager
Yocto Runtime Package Management
PXE boot
OTA updaters: Mender
As with any decision, it is rarely black-and-white and we will cover some of the benefits and the limitations of all the different methods mentioned, to make sure you have the most critical information needed to decide for yourself whether a given strategy would be a good fit for your embedded application development.
This talk will cover how different mechanisms are implemented in the real world and how choosing the right strategy, understanding its benefits and drawbacks, can speed up and improve the whole development process.Hles 2021 Digital transformation - How to use digital tools to improve our ev...
Hles 2021 Digital transformation - How to use digital tools to improve our ev...Henning Spjelkavik
油
This document discusses various tools and strategies for remote collaboration, communication, and document sharing. It provides recommendations for online meeting platforms like Zoom, Google Meet, and Microsoft Teams. It also reviews options for cloud-based document storage and sharing, including Google Drive, Dropbox, and Box. Finally, it considers virtual solutions for remote participation in events like races and trainings.Customer Highlight: Craftsy
Customer Highlight: CraftsyAmazon Web Services
油
by Chris Proto, DevOps Engineer, Craftsy
Craftsy is the leading online destination for passionate makers to learn, create, and share. With online classes, popular supplies and indie patterns, over ten million creative enthusiasts are taking their skills to new heights. By working with AWS and using data transfer services, Crafty was able to bounce back from a massive storage outage that impacted numerous teams. By using AWS storage services, the company was able to minimize the outage and speed up data restore three-fold. Learn more by attending this session.Pipenv - The Python Companion You Wish You Always Had
Pipenv - The Python Companion You Wish You Always HadAvi Aminov
油
Talk given at Pycon IL 2019.
Managing Python environment dependencies across an organization and between environments is always a pain. Pipenv makes it a little less painful by managing both the environment itself and its configuration.
'Import Error: No module named X'. Sounds familiar? Probably all too familiar for most of you. Nearly every time you share pieces of code or send programs for remote execution, you will encounter this message. After all, we're humans and we don't always remember to update the requirements.txt file when installing a new package. So code may work perfectly on one machine, but fails to work on a different machine.
Pipenv to the rescue! With Pipenv, now you can manage your environment and the configuration using the same command. Each time you install a package using Pipenv, a configuration file is updated automatically, and it can then be used to set an environment on a different machine in a reliable manner.
In this talk we will introduce you to Pipenv, the problems it can help you solve, how to use it properly, and caveats from our personal experience.Continuous Deployment Applied at MyHeritage
Continuous Deployment Applied at MyHeritageRan Levy
油
Learn how continuous deployment was applied at MyHeritage. Check out how we automated the process using MCollective, RPM, Jenkins, unit and integration tests using JUnit, PHPUnit, Cucumber and more. Go frugal with web services
Go frugal with web servicesDaniel Fireman
油
The document discusses how PaaS services like Heroku allow developers to build and run web services for free or at low cost by providing infrastructure and additional services. It highlights how Heroku provides free dynos, storage, databases and add-ons that enable agile development, continuous integration and deployment, performance monitoring and high availability without ongoing operations overhead. By leveraging these PaaS capabilities, developers can focus on coding while their applications are hosted and scaled automatically in the cloud.Boosting I/O Performance with KVM io_uring
Boosting I/O Performance with KVM io_uringShapeBlue
油
Storage performance is becoming much more important. KVM io_uring attempts to bring the I/O performance of a virtual machine on almost the same level of bare metal. Apache CloudStack has support for io_uring since version 4.16. Wido will show the difference in performance io_uring brings to the table.
Wido den Hollander is the CTO of CLouDinfra, an infrastructure company offering total Webhosting solutions. CLDIN provides datacenter, IP and virtualization services for the companies within TWS. Wido den Hollander is a PMC member of the Apache CloudStack Project and a Ceph expert. He started with CloudStack 9 years ago. What attracted his attention is the simplicity of CloudStack and the fact that it is an open-source solution. During the years Wido became a contributor, a PMC member and he was a VP of the project for a year. He is one of our most active members, who puts a lot of efforts to keep the project active and transform it into a turnkey solution for cloud builders.
-----------------------------------------
The CloudStack European User Group 2022 took place on 7th April. The day saw a virtual get together for the European CloudStack Community, hosting 265 attendees from 25 countries. The event hosted 10 sessions with from leading CloudStack experts, users and skilful engineers from the open-source world, which included: technical talks, user stories, new features and integrations presentations and more.
------------------------------------------
About CloudStack: https://cloudstack.apache.org/More Related Content
What's hot (15)
From NodeJS to Rust
From NodeJS to RustBastian Gruber
油
The document discusses choosing Rust over NodeJS for software development. It provides an overview of the speaker's background and experience with Rust. Some key differences between NodeJS and Rust mentioned are that Rust has no need for TypeScript or additional tooling, ships binaries, and allows for more performant code through compiler checks. The document also outlines steps for getting started with Rust, including recommended books and practice projects. Popular Rust libraries for web development are also listed.A Shallow Survey of Alternative Languages on the JVM
A Shallow Survey of Alternative Languages on the JVMCharles Anderson
油
This document surveys alternative languages that run on the Java Virtual Machine (JVM), including ported languages like JRuby and new languages like Groovy and Scala. It discusses why developers use these languages, noting they provide access to powerful Java platforms and libraries while allowing programming in more modern languages. Issues like performance and compatibility challenges are also outlined. Examples of code in several languages are provided.Golang
GolangMichael Blake
油
Go is an open source programming language designed for building simple, fast, and reliable software. It is concurrent and garbage collected, with tools to manage dependencies, support version control, and test code. The document discusses Go's philosophy, tools, web development capabilities using net/http, concurrency with goroutines, exception handling without exceptions, popular frameworks, organizations using Go, and references for learning more.Intro to GO (Bangkok Launchpad 2014)
Intro to GO (Bangkok Launchpad 2014)Matthew Campbell
油
The document introduces GO and discusses why a consulting firm chose to build an instant messaging server using GO. It provides an overview of GO, including that it is a lightweight programming language developed by Google that uses garbage collection and makes concurrency easy using goroutines and channels. The document also provides code samples and discusses getting started with GO development.Distributed locks in Ruby - Correctness vs Efficiency - Knapsack Pro case stu...
Distributed locks in Ruby - Correctness vs Efficiency - Knapsack Pro case stu...Artur Trzop
油
This document discusses using distributed locks to synchronize access to shared resources in distributed applications. It provides examples of when distributed locks are needed to prevent data corruption or loss from concurrent requests. The document recommends using proven distributed lock libraries like redis-semaphore and redlock-rb to implement distributed locks instead of recreating the logic. Tips are given on testing for concurrency issues and choosing correctness over efficiency with locks.Chromium OS Introduction
Chromium OS IntroductionWei-Ning Huang
油
Code & Beer #12
Chromium OS Introduction
https://code-beer.hackpad.com/WtAf9qA1qOx#:h=#12-Chromium-OS-IntroductionopenSUSE tools on Debian
openSUSE tools on DebianHideki Yamane
油
openSUSE.Asia Summit 2017 talk slide
https://events.opensuse.org/conference/summitasia17/program/proposal/1512A Recovering Java Developer Learns to Go
A Recovering Java Developer Learns to GoMatt Stine
油
As presented at OSCON 2014.
The Go programming language has emerged as a favorite tool of DevOps and cloud practitioners alike. In many ways, Go is more famous for what it doesnt include than what it does, and co-author Rob Pike has said that Go represents a less is more approach to language design.
The Cloud Foundry engineering teams have steadily increased their use of Go for building components, starting with the Router, and progressing through Loggregator, the CLI, and more recently the Health Manager. As a recovering-Java-developer-turned-DevOps-junkie focused on helping our customers and community succeed with Cloud Foundry, it became very clear to me that I needed to add Go to my knowledge portfolio.
This talk will introduce Go and its distinctives to Java developers looking to add Go to their toolkits. Well cover Go vs. Java in terms of:
* type systems
* modularity
* programming idioms
* object-oriented constructs
* concurrencyHello android
Hello androidDENNIS JUNG
油
This document provides an overview of the Android architecture and tools needed to build a basic "Hello World" Android application. It describes the core Android components like activities, services, and the runtime environment. It also outlines how to set up Android Studio, create a simple project with an activity and layout, add a button to trigger an intent for inter-activity communication, and handle the activity lifecycle.KubeCon EU 2019 - P2P Docker Image Distribution in Hybrid Cloud Environment w...
KubeCon EU 2019 - P2P Docker Image Distribution in Hybrid Cloud Environment w...Yiran Wang
油
Docker image is a foundational building block of container based infrastructure, but distributing high volume of docker images in a multi-zone, hybrid cloud system has been a scaling problem for many.
In this talk, we will walk through different approaches we investigated for distributing docker images and introduce Ubers own solution, Kraken, a P2P docker registry loosely based on BitTorrent protocol, and capable of distributing terabytes of images within seconds.
This talk will cover:
- Image distribution solutions and their characteristics
- Whether you need a p2p solution
- Architecture, performance and security features of Kraken
- How to deploy Kraken in a Kubernetes cluster10 reasons to be excited about go
10 reasons to be excited about goDvir Volk
油
Go is an exciting new programming language developed at Google that focuses on high performance and easing the developer experience. It has many advantages over other languages like C++ such as having a simple, quick to learn syntax, extremely fast compiler and execution speeds, powerful standard library, easy concurrency with goroutines and channels, and implicit interfaces. While still missing some features like a full IDE, Go shows great promise for building scalable server side applications and performing data processing.Command line git
Command line gitManos Emmanouilidis
油
This document provides instructions and explanations for using Git from the command line. It discusses installing Git and related tools, setting up SSH keys, and configuring aliases. The document then explains the basic Git workflow of committing changes locally and pushing them to a central repository. Key Git concepts covered include branches, tags, refs, remotes, and Merkle trees for tracking history. Tips are provided such as committing frequently and using the reflog to recover from mistakes. Resources for learning more about Git are listed at the end.Messing with binary formats
Messing with binary formatsAnge Albertini
油
a 44CON 2013 presentation
slides downloadable (including inception binary) at http://mix.corkami.comOshw documentation project video 1 - lars zimmermann
Oshw documentation project video 1 - lars zimmermannLars Zimmermann
油
This document discusses assumptions for open sourcing hardware. It lists four main assumptions: 1) Platform independence using metaphors of Libre Office (available everywhere) and JSON (machine readable), 2) Complexity arising from simplicity, 3) Producing information simultaneously with physical things, and 4) Implementing circles of participation with inputs, processes, and outputs. It also provides credits and licenses for various images included.A tale of two(many) proxies
A tale of two(many) proxiesMohan Dutt
油
We often find ourselves confounded by the fundamentals when it comes to implementing our own proxy. A Proxy can solve much more than a basic use case, and I will be elaborating on the various scenarios where proxies come in handy and will be speaking about the richness of Golangs httputil package.Similar to Stashaway 1 (20)
Strategies for developing and deploying your embedded applications and images
Strategies for developing and deploying your embedded applications and imagesMender.io
油
We will delve into multiple strategies you can use for developing and deploying code to embedded devices. We will compare and contrast the following:
Lightweight package managers: ipkg/opkg
Desktop package managers: rpm/deb
Configuration Management Tools
Smart Package Manager
Yocto Runtime Package Management
PXE boot
OTA updaters: Mender
As with any decision, it is rarely black-and-white and we will cover some of the benefits and the limitations of all the different methods mentioned, to make sure you have the most critical information needed to decide for yourself whether a given strategy would be a good fit for your embedded application development.
This talk will cover how different mechanisms are implemented in the real world and how choosing the right strategy, understanding its benefits and drawbacks, can speed up and improve the whole development process.Hles 2021 Digital transformation - How to use digital tools to improve our ev...
Hles 2021 Digital transformation - How to use digital tools to improve our ev...Henning Spjelkavik
油
This document discusses various tools and strategies for remote collaboration, communication, and document sharing. It provides recommendations for online meeting platforms like Zoom, Google Meet, and Microsoft Teams. It also reviews options for cloud-based document storage and sharing, including Google Drive, Dropbox, and Box. Finally, it considers virtual solutions for remote participation in events like races and trainings.Customer Highlight: Craftsy
Customer Highlight: CraftsyAmazon Web Services
油
by Chris Proto, DevOps Engineer, Craftsy
Craftsy is the leading online destination for passionate makers to learn, create, and share. With online classes, popular supplies and indie patterns, over ten million creative enthusiasts are taking their skills to new heights. By working with AWS and using data transfer services, Crafty was able to bounce back from a massive storage outage that impacted numerous teams. By using AWS storage services, the company was able to minimize the outage and speed up data restore three-fold. Learn more by attending this session.Pipenv - The Python Companion You Wish You Always Had
Pipenv - The Python Companion You Wish You Always HadAvi Aminov
油
Talk given at Pycon IL 2019.
Managing Python environment dependencies across an organization and between environments is always a pain. Pipenv makes it a little less painful by managing both the environment itself and its configuration.
'Import Error: No module named X'. Sounds familiar? Probably all too familiar for most of you. Nearly every time you share pieces of code or send programs for remote execution, you will encounter this message. After all, we're humans and we don't always remember to update the requirements.txt file when installing a new package. So code may work perfectly on one machine, but fails to work on a different machine.
Pipenv to the rescue! With Pipenv, now you can manage your environment and the configuration using the same command. Each time you install a package using Pipenv, a configuration file is updated automatically, and it can then be used to set an environment on a different machine in a reliable manner.
In this talk we will introduce you to Pipenv, the problems it can help you solve, how to use it properly, and caveats from our personal experience.Continuous Deployment Applied at MyHeritage
Continuous Deployment Applied at MyHeritageRan Levy
油
Learn how continuous deployment was applied at MyHeritage. Check out how we automated the process using MCollective, RPM, Jenkins, unit and integration tests using JUnit, PHPUnit, Cucumber and more. Go frugal with web services
Go frugal with web servicesDaniel Fireman
油
The document discusses how PaaS services like Heroku allow developers to build and run web services for free or at low cost by providing infrastructure and additional services. It highlights how Heroku provides free dynos, storage, databases and add-ons that enable agile development, continuous integration and deployment, performance monitoring and high availability without ongoing operations overhead. By leveraging these PaaS capabilities, developers can focus on coding while their applications are hosted and scaled automatically in the cloud.Boosting I/O Performance with KVM io_uring
Boosting I/O Performance with KVM io_uringShapeBlue
油
Storage performance is becoming much more important. KVM io_uring attempts to bring the I/O performance of a virtual machine on almost the same level of bare metal. Apache CloudStack has support for io_uring since version 4.16. Wido will show the difference in performance io_uring brings to the table.
Wido den Hollander is the CTO of CLouDinfra, an infrastructure company offering total Webhosting solutions. CLDIN provides datacenter, IP and virtualization services for the companies within TWS. Wido den Hollander is a PMC member of the Apache CloudStack Project and a Ceph expert. He started with CloudStack 9 years ago. What attracted his attention is the simplicity of CloudStack and the fact that it is an open-source solution. During the years Wido became a contributor, a PMC member and he was a VP of the project for a year. He is one of our most active members, who puts a lot of efforts to keep the project active and transform it into a turnkey solution for cloud builders.
-----------------------------------------
The CloudStack European User Group 2022 took place on 7th April. The day saw a virtual get together for the European CloudStack Community, hosting 265 attendees from 25 countries. The event hosted 10 sessions with from leading CloudStack experts, users and skilful engineers from the open-source world, which included: technical talks, user stories, new features and integrations presentations and more.
------------------------------------------
About CloudStack: https://cloudstack.apache.org/Improve the deployment process step by step
Improve the deployment process step by stepDaniel Fahlke
油
This document summarizes steps to improve the software deployment process. It recommends using Git for deployment to enable faster switching between versions. It also discusses techniques like blue/green deployments to prevent errors from file changes during requests and maintaining two identical environments that can be switched between. The document stresses the importance of making database migrations harmless and avoiding code that doesn't work without migrations. It provides tips for measuring deployment success and reducing fear of deployments.NetflixOSS meetup lightning talks and roadmap
NetflixOSS meetup lightning talks and roadmapRuslan Meshenberg
油
The document outlines an agenda for a Netflix OSS meeting that includes lightning talks from 7:00-7:20 PM, a Netflix OSS roadmap presentation from 7:20-7:30 PM, an announcement from 7:30-7:45 PM, and demo stations and Q&A from 8:00-9:30 PM. It also summarizes several Netflix OSS projects including Karyon, Denominator, Aminator, NetflixGraph, and Netflix OSS continuous integration.PyConFR 2014 - DEPOT, Story of a file.write() gone wrong
PyConFR 2014 - DEPOT, Story of a file.write() gone wrongAlessandro Molina
油
DEPOT ( http://depot.readthedocs.org/en/latest/ ) is a file storage framework born from the experience on a project that saved a lot of files on disk, until the day it went online and the customer system engineering team diceded to switch to Heroku, which doesn't support storing files on disk.
Like SQLAlchemy makes possible to switch your storage on the fly without touching code, DEPOT aims at making so possible for files and even use multiple different storages together.Pen Testing Development
Pen Testing DevelopmentCTruncer
油
This presentation was given to a group of SFS students at GW. It's designed to be semi-case study driven on the problems I've encountered on assessments and how programming can help solve them.Do You Get Git? 
Do You Get Git? Prasid Pathak
油
Dave is the CTO of Bloc and has been programming since childhood. He will give an introduction to version control using Git, including covering what version control is, its history from early tools to Git, Git terminology and basics with a demo, collaborating on GitHub using branches and pull requests with another demo, and publishing code directly from Git to Heroku. The agenda includes advanced Git features and a Q&A session.Spark and S3 with Ryan Blue
Spark and S3 with Ryan BlueDatabricks
油
Netflixs Big Data Platform team manages data warehouse in Amazon S3 with over 60 petabytes of data and writes hundreds of terabytes of data every day. At this scale, output committers that create extra copies or cant handle task failures are no longer practical. This talk will explain the problems that are caused by the available committers when writing to S3, and show how Netflix solved the committer problem.
In this session, youll learn:
Some background about Spark at Netflix
About output committers, and how both Spark and Hadoop handle failures
How HDFS and S3 differ, and why HDFS committers dont work well
A new output committer that uses the S3 multi-part upload API
How you can use this new committer in your Spark applications to avoid duplicating dataAWS Customer Highlight - Craftsy
AWS Customer Highlight - CraftsyAmazon Web Services
油
Craftsy is the leading online destination for passionate makers to learn, create, and share. With online classes, popular supplies and indie patterns, over ten million creative enthusiasts are taking their skills to new heights. By working with AWS and using data transfer services, Crafty was able to bounce back from a massive storage outage that impacted numerous teams. By using AWS storage services, the company was able to minimize the outage and speed up data restore three-fold. Learn more by attending this session. Schizophrenic files v2
Schizophrenic files v2Ange Albertini
油
This document summarizes a talk about abusing file format parsers to cause different parsing behaviors, known as "schizophrenia". It describes techniques used across various formats like ZIP, BMP, PDF, GIF and PE files that can result in files being parsed or interpreted differently depending on factors like the parsing order, which part of a program does the parsing, or which specifications are followed. The goal is to fool parsers without causing failures by leveraging ambiguity and flexibility in file specifications.Hadoop Meetup Jan 2019 - Overview of Ozone
Hadoop Meetup Jan 2019 - Overview of OzoneErik Krogen
油
A presentation by Anu Engineer of Cloudera regarding the state of the Ozone subproject. He covers a brief introduction of what Ozone is, and where it's headed.
This is taken from the Apache Hadoop Contributors Meetup on January 30, hosted by LinkedIn in Mountain View.Apache Iceberg - A Table Format for Hige Analytic Datasets
Apache Iceberg - A Table Format for Hige Analytic DatasetsAlluxio, Inc.
油
Data Orchestration Summit
www.alluxio.io/data-orchestration-summit-2019
November 7, 2019
Apache Iceberg - A Table Format for Hige Analytic Datasets
Speaker:
Ryan Blue, Netflix
For more Alluxio events: https://www.alluxio.io/events/LAS16-209: Finished and Upcoming Projects in LMG
LAS16-209: Finished and Upcoming Projects in LMGLinaro
油
LMG's finished and upcoming projects include:
- Memory allocator and file system analyses to reduce memory usage on low-RAM devices.
- Monthly LCR releases and migrating their builds to ci.linaro.org.
- Updating toolchains and enabling new hardware like the HiKey board in AOSP.
- Increasing participation in upstream projects like merging an SystemUI patch.
- Integrating features in AOSP like Energy Aware Scheduling, OP-TEE, and an Overlay Manager.
- Continuing work on the HiKey board in AOSP including new features, fixes, and upstreaming components.The DuraCloud Workshop - Open Repositories 2015
The DuraCloud Workshop - Open Repositories 2015DuraSpace
油
The document provides an overview of an upcoming DuraCloud workshop. It will cover the basics of DuraCloud, its architecture and integrations, and include hands-on labs. Attendees will learn about uploading, storing, and managing content in DuraCloud and how it can work with other digital preservation systems like DSpace, Archivematica, and the Digital Preservation Network.The history of Prometheus at SoundCloud
The history of Prometheus at SoundCloudTobias Schmidt
油
The way SoundCloud monitors its services and infrastructure has dramatically changed over the last couple of years. Monitoring, alerting, and being on-call is now deeply ingrained in every engineering team and we have learned a lot on the way.
This talk explains the goals and reasons Prometheus was born, show the early history of the project and how it has helped SoundCloud to fundamentally change its monitoring to support the rapid development of services.Stashaway 1
- 1. Stashaway Fixing digital media organization
- 2. What problems are we solving? Devices are getting smaller local storage is becoming expensive Cloud Storage is getting popular remote storage is becoming cheaper Data is moving from Local to Remote "Sync paradigm" Dropbox model, git model is great for mutable data (documents) Works best with hierarchical file structures "Send paradigm" physical disk model is better for immutable data (media) Works best with metadata-based filesystems
- 3. Sync paradigm sucks for mutable data! Sync is everywhere Photostream Duplicates everywhere! Organizational nightmare Sync for media is terrible! Google music and Itunes stashaway is bringing send paradigm back! stashaway is for mutable data Videos, Pictures, music, archives, etc. stashaway strongly encourages workflows that favor move/delete discourages copy
- 4. stashaway in detail brew install stashaway stashaway setup Makes a ~/.stashaway file. Takes API keys, and preferences. stashaway upload file.avi sends file to the remote file storage resume when connection is interrupted deletes file locally stashaway list List all files in all remote stores uploaded with stashaway stashaway stream file streams file from remote store for viewing/listening
- 5. Additional features (to be added later) file tagging automatic duplicate detection GUI extensible storage backends other bells and whistles
- 6. Development Timeline Phase one - Research and Experimentation Been going on since 2011 look at the problem from many perspectives Everything is up in the air Contains many false starts Phase two - Breaking ground Will be fast, possibly one week Do everything right, low technical debt Phase three - Beta and beyond Launch is unceremonious Iterations happen at the speed of phase two quick phase two == fast iteration == agile slow phase two == slow iteration == expensive
- 7. Phase One status Language Compiled -> C languages, haskell Interpreted -> Python (restricted to STDlib) Distribution will be difficult if using python Current Winner -> C Hard stuff Amazon API signing SSL / encryption Reacquaintance with C language/ecosystem Distribution (installer/homebrew/apt-get integration) Potentially Hard stuff Dropbox README Driven Approach
- 8. Upcoming videos Video 2 Getting C up and running More small refinements to the README Still to come: Easier Distribution using Python Homebrew / apt-get bureaucracy Refinements to the README feedback Production details github: https://github.com/priestc/stashaway Next video comes when I have enough content to make it into a video If you want to contribute, please do so!