free api methods part 1

free api methods part 1

Building on last month’s post, for a fixed amount of time, I’m making various API methods discussed on our website freely available. For example, you can GET arxiv figure data using the following curl, where of course the query string must correspond to data in our database: curl -k ‘https://plot2txt-staging.us-east-1.elasticbeanstalk.com/record?type=figure&source=astro&label=temp’ Here we’re requesting figures fromContinue Reading free api methods part 1

arxiv mining

arxiv mining

Some time ago I launched a little project, mining data from arxiv; you can read about it in other blog posts. Specifically, I modeled figures from about 500k figures as Gaussian mixture models, in order to create some features, so figures might be ultimately represented as graphs for comparison. More ordinary methods might suffice tooContinue Reading arxiv mining

DevOps with AWS

DevOps with AWS

One of the distinct advantages of devOps philosophy as implemented using AWS is the ability to rapidly kick out a new service. The new template-match API is a good example. Knowing the algorithm, I was able to quickly pull something together from the p2t C++ library, an example input image attached. The algorithm determines whereContinue Reading DevOps with AWS

Lambdas: Epilogue

Lambdas: Epilogue

I’ve spent some time coming to grips with nodejs, in order to develop truly functional lambda functions. Thinking asynchronously (something nodejs is adept at) is a little challenging if you’re not accustomed to it. While the AWS examples are very useful, the process of uploading and triggering through the console doesn’t make for quick turnContinue Reading Lambdas: Epilogue

Lambda Functions Part 3

Lambda Functions Part 3

Allegedly we’ve laid the groundwork, let’s dive in and see if we can create the Lambda function that will work with S3 containers, as described in the last post. From the CLI, this is a simple matter of executing the following: $ aws lambda create-function –region us-east-1 –function-name CreateThumbnail –zip-file fileb://textTN.zip –role arn:aws:iam::485603662400:role/lambda_s3_exec_role –handler CreateThumbnail.handlerContinue Reading Lambda Functions Part 3