How to use the joblibspark.backend.register function in joblibspark

To help you get started, we’ve selected a few joblibspark examples, based on popular ways it is used in public projects.

Secure your code as it's written. Use Snyk Code to scan source code in minutes - no build needed - and fix issues immediately.

github joblib / joblib-spark / joblibspark / __init__.py View on Github external
def register_spark():
    """
    Register spark backend into joblib.
    """
    try:
        from .backend import register # pylint: disable=C0415
        register()
    except ImportError:
        msg = ("To use the spark.distributed backend you must install "
               "the pyspark and packages.\n\n")
        raise ImportError(msg)

joblibspark

Joblib Apache Spark Backend

Apache-2.0
Latest version published 3 months ago

Package Health Score

77 / 100
Full package analysis

Similar packages