new api method for data image search

new api method for data image search

As mentioned, after doing some experiments for the KDnuggets article, I bundled some of the existing API methods into a new one, which will extract from a page figures that have x/y scaling information. The JSON output is well suited to elasticsearch or your favorite flavor of NoSQL eg., an extract of the response: [{“input”:”tmp/quant-ph0002044-9.png”,Continue Reading new api method for data image search

arxiv mining

arxiv mining

Some time ago I launched a little project, mining data from arxiv; you can read about it in other blog posts. Specifically, I modeled figures from about 500k figures as Gaussian mixture models, in order to create some features, so figures might be ultimately represented as graphs for comparison. More ordinary methods might suffice tooContinue Reading arxiv mining

API Gateway Perf

API Gateway Perf

At the time of writing, AWS API gateway doesn’t support gzip requests, so I’ve been handling this at the lambda function itself and client side. Obviously compression makes a dramatic difference w.r.t performance, just ask the guys at Pied Piper 🙂 Another curious absence is support for multipart form data; attached a screen grab fromContinue Reading API Gateway Perf

EC2 Optimization

EC2 Optimization

We attended the AWS San Francisco Summit in April and were really impressed with the breadth and depth of the presentations. A stand out included this talk from Adam Boeglin on optimization. As we prepare to finally commercialize RESTful APIs, it’s clear a few lambda functions need a little tuning; this talk as some greatContinue Reading EC2 Optimization