ºÝºÝߣ

ºÝºÝߣShare a Scribd company logo
mindcraft.ai
Contour Detection using Differentiable Programming
- openCV BLOB + Convex Hull
- edge detection
- semantic segmentation with CNNs
- contour -> point
opencv.org
mindcraft.ai
Input Data
- AHN - Actual Heights Netherlands
- variety of objects
- granularity 10-30cm
- limited coverage
ahn.nl
mindcraft.ai
Data Processing
- blob detection
- clustering
- point cloud -> heatmap
mindcraft.ai
mindcraft.ai
Classical to Differentiable Coding
make code vectorized and parallel
replace constant with weights
replace conditions with sigmoid
replace loops with vectors and RNN
soft and smooth everywhere
colah.github.io, wikipedia.org
mindcraft.ai
Build a Plane by three points
- find NORM of two available vectors
- every vector on the plane has to be
orthogonal to the NORM
- take any (X,Y) point as a top of vector
- calculate Z having X and Y in Grid
wikipedia.org
mindcraft.ai
Fill Polygon (Shadow)
- break polygon by edges
- every co-vector to the given edge will have positive or
negative Z of cross product, depending on the position
- use third given point as a flag and compare the previous
result to it
- combine as SUM
wikipedia.org
mindcraft.ai
Sigmoid 3D
- break polygon by edges
- calc distance from every point to the edge
- reverse use Pythagorean Theorem
- apply sign from polygon to the distance and take sigmoid
- combine as PROD
wikipedia.org, researchgate.net
mindcraft.ai
Training in Dynamics
mindcraft.ai
Training Results Visualization
- extra noise caused
by smoothing
- balance between accuracy
and scope
mindcraft.ai
Next Steps
- from contour to 3D
- more polygons
- control overlapping
- control focusing
- side view aux models
mindcraft.ai
EMNIST handwritten recogniser
using Differentiable Programming
mindcraft.ai
Handwritten style
mindcraft.ai
Das ist MindCraft
Decision-making Engines for Data-driven Businesses, especially:
- Document and Web pages Classification, Capturing (NLP, CNN, CV, NER)
- Price Prediction (DNN, Regression, Prognosis)
- Command Centers for IoT systems (RNN, Time Series, Anomaly Detection)
- Computer Vision and Object Detection
- Data Analysis and Generation

More Related Content

Andy Bosyi: Contour Detection using Differentiable Programming