The AWS Data Processing MCP server (Model Context Protocol) provides AI code assistants with comprehensive data processing tools and real-time pipeline visibility across AWS Glue, Amazon EMR-EC2, and Athena. It enables AI code assistants to streamline data processing workflows through intelligent guidance, from initial data discovery and cataloging through complex ETL pipeline orchestration and big data analytics optimization. The current version is 0.1.28, and it is actively maintained as part of the AWS Labs MCP server initiative.
pip install awslabs-aws-dataprocessing-mcp-serverNo compatibility data collected yet for this library.
The AWS Data Processing MCP Server is typically run by an MCP client (e.g., Amazon Q Developer CLI, Kiro, Cursor) rather than being directly imported into Python code. To get started, configure your MCP client (e.g., by editing `~/.aws-q-developer-cli/mcp/mcp.json` for Amazon Q Developer CLI or `~/.kiro/settings/mcp.json` for Kiro) with the server definition. This JSON snippet provides an example configuration for launching the server, enabling write operations, and specifying the AWS region and profile. Replace `us-east-1` and `my-mcp-profile` with your desired values. Ensure your AWS credentials are configured for the specified profile.
Clients should prepare for Streamable HTTP support. Check client documentation for updates on streaming capabilities.
Always review the IAM permissions granted to the role or user running the MCP server and restrict them to the minimum necessary. Only use write and sensitive data access in controlled setups.
Plan your resource management strategy accordingly, understanding that resources created outside of the MCP server's scope will require manual intervention or alternative tools for modification/deletion.
Organizations should carefully evaluate these challenges and consider MCP for production deployments with caution. Prioritize security reviews, robust monitoring, and compliance frameworks.
Correct the server package name in your MCP client configuration (e.g., `mcp.json`) from `aws-aws-dataprocessing-mcp-server` to `awslabs.aws-dataprocessing-mcp-server@latest`.
Review and update your IAM policies to grant the required permissions to the entity running the MCP server. Ensure that `iam:PassRole` is allowed if the server needs to assume other roles. Consult AWS IAM documentation for specific service permissions.
To enable write operations, you must explicitly include the `--allow-write` argument in the MCP server's command definition within your client configuration.