Modzy's Javascript SDK queries models, submits inference jobs, and returns results directly to your editor.
Use yarn to package and install the SDK:
Globally:
$ yarn global add @modzy/modzy-sdk
In an existing project:
$ yarn add @modzy/modzy-sdk
Or you can use npm:
Globally
$ npm install -g @modzy/modzy-sdk
In an existing project:
$ npm install @modzy/modzy-sdk
You can also install from Github:
$ npm install modzy/sdk-javascript
Once you have a model and version identified, get authenticated with your API key.
API keys are security credentials required to perform API requests to Modzy. Our API keys are composed of an ID that is split by a dot into two parts: a public and private part.
The public part is the API keys' visible part only used to identify the key and by itself, it’s unable to perform API requests.
The private part is the public part's complement and it’s required to perform API requests. Since it’s not stored on Modzy’s servers, it cannot be recovered. Make sure to save it securely. If lost, you can replace the API key.
Find your API key in your user profile. To get your full API key click on "Get key":
Get authenticated with your API key:
const modzy = require('modzy-sdk');
const modzyClient = new modzy.ModzyClient("http://url.to.modzy/api", "API Key");
Modzy’s Marketplace includes pre-trained and re-trainable AI models from industry-leading machine learning companies, accelerating the process from data to value.
The Model service drives the Marketplace and can be integrated with other applications, scripts, and systems. It provides routes to list, search, and filter model and model-version details.
const models = await modzyClient.getAllModels();
models.forEach(
model => {
console.log(JSON.stringify(model));
}
);Tags help categorize and filter models. They make model browsing easier.
const tags = await modzyClient.getAllTags();
tags.forEach(
tag => {
console.log(JSON.stringify(tag));
}
);const tagsModels = await modzyClient.getTagsAndModels("language_and_text");
tagsModels.models.forEach(
model => {
console.log(JSON.stringify(model));
}
);Models accept specific input file MIME types. Some models may require multiple input file types to run data accordingly. In this sample, we use a model that requires text/plain.
Models require inputs to have a specific input name declared in the job request. This name can be found in the model’s details. In this sample, we use a model that requires input.txt.
Additionally, users can set their own input names. When multiple input items are processed in a job, these names are helpful to identify and get each input’s results. In this sample, we use a model that requires input-1 and input-2.
const saModel = await modzyClient.getModel("ed542963de");
console.log(JSON.stringify(saModel));Model specific sample requests are available in the version details and in the Model Details page.
let modelVersion = await modzyClient.getModelVersion("ed542963de", "0.0.27");
console.log("inputs:");
for(key in modelVersion.inputs){
let input = modelVersion.inputs[key];
console.log(` key ${input.name}, type ${input.acceptedMediaTypes}, description: ${input.description}`);
}
console.log("outputs:");
for(key in modelVersion.outputs){
let output = modelVersion.outputs[key];
console.log(` key ${output.name}, type ${output.mediaType}, description: ${output.description}`);
}A job is the process that sends data to a model, sets the model to run the data, and returns results.
Modzy supports several input types such as text, embedded for Base64 strings, aws-s3 and aws-s3-folder for inputs hosted in buckets, and jdbc for inputs stored in databases. In this sample, we use text.
Here are samples to submit jobs with embedded, aws-s3, aws-s3-folder, and jdbc input types.
Submit a job with the model, version, and input items:
let job = await modzyClient.submitJobText(
"ed542963de",
"0.0.27",
{
'input-1':{'input.txt':'Modzy is great'},
'input-2':{'input.txt':'Modzy is great'},
}
);Hold until the inference is complete and results become available:
job = await modzyClient.blockUntilComplete(job);Results are available per input item and can be identified with the name provided for each input item upon job request. You can also add an input name to the route and limit the results to any given input item.
Jobs requested for multiple input items may have partial results available prior to job completion.
let results = await modzyClient.getResult(job.jobIdentifier);Errors may arise for different reasons. Fetch errors to know what is their cause and how to fix them.
| Error | Description |
|---|---|
ApiError |
Wrapper for different errors, check code, message, url attributes. |
Submitting jobs:
try{
let job = await modzyClient.submitJobText("ed542963de","0.0.27",{'input-1':{'input.txt':'Modzy is great'},});
} catch(error){
console.log("the job submission fails with code "+error.code+" and message "+error.message);
}Modzy supports batch processing, explainability, and model drift detection.
Here is a list of Modzy APIs. To see all the APIs, check our Documentation.
| Feature | Code | Api route |
|---|---|---|
| Get all models | modzyClient.getAllModels() | api/models |
| List models | modzyClient.getModels() | api/models |
| Get model details | modzyClient.getModel() | api/models/:model-id |
| List models by name | modzyClient.getModelByName() | api/models |
| List models by tag | modzyClient.getAllTags() | api/models/tags |
| Get related models | modzyClient.getRelatedModels() | api/models/:model-id/related-models |
| Get a model's versions | modzyClient.getModelClient().getModelVersions() | api/models/:model-id/versions |
| Get version details | modzyClient.getModelVersion() | api/models/:model-id/versions/:version-id |
| List tags | modzyClient.getAllTags() | api/models/tags |
| Submit a Job (Text) | modzyClient.submitJobText() | api/jobs |
| Submit a Job (Embedded) | modzyClient.submitJobEmbedded() | api/jobs |
| Submit a Job (AWS S3) | modzyClient.submitJobAWSS3() | api/jobs |
| Submit a Job (JDBC) | modzyClient.submitJobJDBC() | api/jobs |
| Cancel a job | modzyClient.cancelJob() | api/jobs/:job-id |
| Hold until inference is complete | modzyClient.blockUntilComplete() | api/jobs/:job-id |
| Get job details | modzyClient.getJob() | api/jobs/:job-id |
| Get results | modzyClient.getResults() | api/results/:job-id |
| List the job history | modzyClient.getJobHistory() | api/jobs/history |
Check out our samples for details on specific use cases.
To run samples:
Set the base url and api key in each sample file:
// TODO: set the base url of modzy api and you api key
const modzyClient = new modzy.ModzyClient("http://modzy.url", "modzy-apy.key");Or follow the instructions here to learn more.
And then, you can:
`$ node samples/job_with_text_input_sample.js`We are happy to receive contributions from all of our users. Check out our contributing file to learn more.
