Migrating existing REST API Server to Serverless with AWS Lambda, MongoDB and Serverless Framework

With the increased interest in serverless backend development, companies, startups have began to look towards migrating their exiting projects from using a server to essentially a serverless server*.

Serverless has different meanings depending on the context. It could be a third party managed services like Firebase or an event driven service.

In this tutorial, you will learn how to migrate your existing project to a serverless approach using AWS Lambda, MongoDB, and Serverless Framework.

Table of Contents

Application: A Movie App

The movie app is a simple CRUD based application that stores, retrieves, updates and deletes movies from a MongoDB database. The application is written in Fastify but the process is the same for every other NodeJS Framework e.g, Express, Hapi, Koa.

Prerequisites

  • AWS Account
  • Node.js
  • Configured AWS CLI (for deployment)
  • Serverless CLI (we will be running it locally)

Terms

Serverless Framework: The Serverless Framework is a framework that allows you to build Serverless applications. It is provider-agnostic meaning it you can use it to build quite a number of serverless providers. Read more on their.

AWS Lambda: AWS Lambda is and event-driven serverless computing platform, meaning, it executes your code in response to event. It is the third compute service from Amazon. The others being EC2 (Elastic Compute Cloud) and ECS (Elastic Container Service).

Enough talk. Let's get into the code

Yosh! Show me dah Code!

Alright alright, even I am getting tired of talk. Let's code

This is might be a given, but be sure to clone your code and not edit the original one,

It may not affect but it's makes for freedom to edit to satisfaction

Step 1:

NOTE: As of this writing serverless is only supported up to node v15.4.0 details.

You can use your node version manager to install the specific node version. I use nvm

Install Serverless CLI

(Recommended to install system wide, makes for easy cli usage outside your current project)

$ npm install -g serverless

(if you are not interested in installing system wide)

$ cd your-project-directory
$ npm install --save serverless

This command will install serverless and makes available 2 commands serverless & sls. sls is an alias to serverless

Step 2:

Add Serverless to your current project

$ sls create --template aws-nodejs --name <custom-unique-name>

This will create three files

.
├── .npmignore
├── handler.js
└── serverless.yml

Explanation time (bear with me)

  1. .npmignore: This file tells npm which files should be kept outside of the package
  2. handler.js: Contains the boilerplate code. 
'use strict';

module.exports.hello = async (event) => {
  return {
    statusCode: 200,
    body: JSON.stringify(
      {
        message: 'Go Serverless v1.0! Your function executed successfully!',
        input: event,
      },
      null,
      2
    ),
  };

  // Use this code if you don't use the http event with the LAMBDA-PROXY integration
  // return { message: 'Go Serverless v1.0! Your function executed successfully!', event };
};
  1. serverless.yml: The entry point file. Without it, Serverless won't run. It has three sections - provider, functions, resources, plugins, etc.
  • provider: This section declares configuration specific to a cloud provider. (in this case AWS). It can also be used to specify region, stage, runtime etc. 
provider:
  name: aws
  runtime: nodejs12.x
  lambdaHashingVersion: 20201221
  stage: dev
  region: us-west-1
  ...
  • functions: This section is used to specify all the functions that are available for your service (the --name flag we specified when adding adding serverless) 
functions:
hello:
  handler: handler.hello
  ...
  • resources: This section specifies all the resouces that your functions can use. They can be declared using AWS CloudFormation. 
resources:
Resources:
  NewResource:
    Type: AWS::S3::Bucket
    Properties:
      BucketName: my-new-bucket
Outputs:
   NewOutput:
     Description: "Description for the output"
     Value: "Some output value"

Step 4:

Update serverless.yml file
We will configure the serverless.yml file to reference your existing API endpoints and other configurations

I won't bore you with the details, you can update it as shown below. It should work for your application too

service: <autogenerated> # Service name (must be unique for your account, no two services can share the same name)

frameworkVersion: "2" # Recommended to pin it to a working version so updates won't break your application

provider:
  name: aws # Name of the cloud provider
  runtime: nodejs14.x # node runtime that the deploy will work on, this is different from the nodejs version required for sls to run
  lambdaHashingVersion: 20201221 # Recommended (honestly, no idea why. Lemme know in the comments what it means)
  memorySize: 130 # Memory size required for lambda functions to run
  timeout: 10 # 10s timeout for a request to be cancelled
  stage: {opt:stage, 'dev'} # Stage to run the functions, it is used for development process to specify which ENV to run
  region: eu-west-1 # Optional override, it will be automatically set from AWS

functions:
  api: # can be any name, this will be mapped to the functions on lambda. It has to be unique
    handler: handler.api # The file.exportedFunction that the functions will be use when the event is created
    events:
      - http: ANY / # RegExps all the HTTP Routes GET|POST|PUT|PATCH|DELETE|OPTIONS, etc.
      - http: ANY /{proxy+} # If your routes use queries and parameters

Oh look, I ended up adding the details. Make sure to remove the comments.

Step 5:

Install the aws-lambda-fastify

npm install aws-lambda-fastify

Open handler.js using your editor and update it as follows

const awsLambdaFastify = require('aws-lambda-fastify');
const app = require('./app');

const proxy = awsLambdaFastify(app);

exports.api = (event, context) => proxy(event, context);

Step 6:

Open app.js and update it

const fastify = require('fastify');
const cors = require('fastify-cors');

const mongoose = require('mongoose');
require('dotenv').config();

const controllers = require('./controllers');

const MONGO_URI = process.env.MONGO_URI || 'mongodb://localhost:27017/movie';
const PORT = process.env.PORT || 3000;

// Connect to the db
mongoose
  .connect(MONGO_URI, {
    useCreateIndex: true,
    useFindAndModify: false,
    useNewUrlParser: true,
    useUnifiedTopology: true,
  })
  .then((connection) => {
    console.log(`Database connected ::: ${connection.connection.host}`);
  })
  .catch((err) => {
    console.error(`Error ::: ${err.message}`);
    process.exit();
  });

// Initialize app
const app = fastify();

// CORS
app.register(cors, {
  origin: '*',
});

// Routes
app.get('/', controllers.getAll);
app.post('/create', controllers.create);
app.get('/:id', controllers.getOne);
app.put('/:id/update', controllers.updateOne);
app.delete('/:id/delete', controllers.deleteOne);

// Run as backend server if the file is called directly
if (require.main === module) {
  app.listen(PORT, (err) => {
    if (err) console.error(err);
    console.log(`server running on ${PORT}`);
  });
} else {
  // Execute as aws lambda function when required as a module
  module.exports = app;
}

As noticed here, there's not much change except

// Run as backend server if the file is called directly
if (require.main === module) {
  app.listen(PORT, (err) => {
    if (err) console.error(err);
    console.log(`server running on ${PORT}`);
  });
} else {
  // Execute as aws lambda function when required as a module
  module.exports = app;
}

Which runs the file as normal server if called directly node app.js and runs it as a function when imported from our handler.js file

Another change is in the controllers.js file
we will replace req,res with event since our requests are now events but it works the same. Fastify Power!

// const create = async (req,res) {
const create = async (event) => {
  try {
    const newMovie = await Movie.create(event.body); // Events are sent in JSON format
    return {
      statuCode: 201,
      body: JSON.stringify(
        {
          message: 'new movie created',
          newMovie,
        },
        null,
        2
      ),
    };
  } catch (err) {
    return {
      statuCode: err.code || 500,
      message: JSON.stringify(err),
    };
  }
};
...

Next is the way we return responses, we will have to stringify (JSON.stringify(data)) the responses (AWS Lambda Recommended) and structure it as above.

Phew! that was a stretch, I need a cup of coffee ....Alright, let's continue

Step 7:

Now we can deploy our app to AWS!
Now we can deploy to AWS.png
Hehe, not yet young padwan.

Testing our application locally (dev) is really important so we don't end up causing cataclysmic situation. That's where serverless-offline comes in

Explanation Time!: Serverless Offline is a Serverless plugin that emulates AWS and API Gateway on your local machine to speed up your development cycles. - Serverless

How do we integrate it to our application? Glad you asked. It takes two easy steps
Install the npm package as devDependecy

npm install --save-dev serverless-offline

Next we will plug-in 👓 it to our serverless.yml file

...
plugins:
  - serverless-offline

Yosh! let's now run it locally

sls offline start

running this command will show this output
Screenshot 2021-07-24 at 23.20.06.png

When we visit Postman (or any REST Client you use) and perform the CRUD Operations

  • Create movie

  • Get all movies
    Screenshot 2021-07-24 at 23.23.29.png

  • Get one movie

  • Update one movie
  • Delete movie

Now that we are done testing our app locally, time to deploy it. Ah finally!

First we have to configure AWS CLI. Follow the steps here

Done? Good, let's continue.

run

sls deploy

to deploy your application

PS: I couldn't deploy mine, for some reason, I can't access my AWS account, story for later.

It will display the url to your application should the deploy succeed, test the endpoints and you should be good to go

And that's it. You have successfully migrated your existing app to AWS Lambda using Serverless Framework.

The link to the Repository

Was the guide straightforward enough to follow?, did you get lost somewhere?, let me know in the comments.

Follow me for more 'straightforward' tutorials such as this.

KodeRant](https://koderant.hashnode.dev/)

35

Tags:

ServerlessRestapiFastifyAwslambda