A rule defines a series of actions that Bazel should perform on
inputs to get a set of outputs. For example, a C++ binary rule might take a set
of .cpp files (the inputs), run g++ on them (the action), and return an
executable file (the output).
Note that, from Bazel's perspective, g++ and the standard C++ libraries are
also inputs to this rule. As a rule writer, you must consider not only the
user-provided inputs to a rule, but also all of the tools and libraries required
to execute the actions.
Before creating or modifying any rule, make sure you are familiar with the evaluation model. You must understand the three phases of execution and the differences between macros and rules.
A few rules are built into Bazel itself. These native rules, such as
cc_library and java_binary, provide some core support for certain languages.
By defining your own rules, you can add similar support for languages and tools
that Bazel does not support natively.
Rules defined in .bzl files work just like native rules. For example, their
targets have labels, can appear in bazel query, and get built whenever they
are needed for a bazel build command or similar. When defining your own rule,
you get to decide what attributes it supports and how it generates its outputs.
The exact behavior of a rule during the
analysis phase is governed by its
implementation function. This function does not run any external commands.
Rather, it registers actions that will be used later during the
execution phase to build the rule's outputs, if they are needed. Rules also
produce and pass along information that may be useful to other rules, in the
form of providers.
In a .bzl file, use the rule
function to create a new rule and store it in a global variable:
my_rule = rule(...)
The rule can then be loaded in BUILD files:
load('//some/pkg:whatever.bzl', 'my_rule')
An attribute is a rule argument, such as srcs or deps. You must list the
names and schemas of all attributes when you define a rule. Attribute schemas
are created using the attr module.
sum = rule(
implementation = _impl,
attrs = {
"number": attr.int(default = 1),
"deps": attr.label_list(),
},
)
In a BUILD file, call the rule to create targets of this type:
sum(
name = "my-target",
deps = [":other-target"],
)
sum(
name = "other-target",
)
Here other-target is a dependency of my-target, and therefore other-target
will be analyzed first.
There are two special kinds of attributes:
Dependency attributes, such as attr.label and attr.label_list,
declare a dependency from the target that owns the attribute to the target
whose label appears in the attribute's value. This kind of attribute forms the
basis of the target graph.
Output attributes, such as attr.output and attr.output_list, declare an
output file that the target generates. Although they refer to the output file
by label, they do not create a dependency relationship between targets. Output
attributes are used relatively rarely, in favor of other ways of declaring
output files that do not require the user to specify a label.
Both dependency attributes and output attributes take in label values. These may
be specified as either Label objects or as simple strings.
If a string is given, it will be converted to a Label using the
constructor. The repository, and possibly the path, will
be resolved relative to the defined target.
If an attribute schema is defined in the rule but no value for that attribute is
given when the rule is instantiated, then the rule implementation function will
see a placeholder value in ctx.attr. The placeholder value depends on the type
of attribute. If the schema specifies a default value, that value will be used
instead of the placeholder. The schema may also specify mandatory=True, in
which case it is illegal for the user to not give an explicit value. It is not
useful for an attribute schema with mandatory to also have a default.
The following attributes are automatically added to every rule: deprecation,
features, name, tags, testonly, visibility. Test rules also have the
following attributes: args, flaky, local, shard_count, size,
timeout.
A dependency attribute with a default value is called an implicit dependency. The name comes from the fact that it is a part of the target graph that the user does not specify in a BUILD file. Implicit dependencies are useful for hard-coding a relationship between a rule and a tool (such as a compiler), since most of the time a user is not interested in specifying what tool the rule uses. From the rule's point of view, the tool is still an input, just like any source file or other dependency.
Sometimes we want to not only provide a default value, but prevent the user from
overriding this default. To do this, you can make the attribute private by
giving it a name that begins with an underscore (_). Private attributes must
have default values. It generally only makes sense to use private attributes for
implicit dependencies.
metal_binary = rule(
implementation = _metal_binary_impl,
attrs = {
"srcs": attr.label_list(),
"_compiler": attr.label(
default = Label("//tools:metalc"),
allow_single_file = True,
executable = True,
),
},
)
In this example, every target of type metal_binary will have an implicit
dependency on the compiler //tools:metalc. This allows metal_binary's
implementation function to generate actions that invoke the compiler, even
though the user did not pass its label as an input. Since _compiler is a
private attribute, we know for sure that ctx.attr._compiler will always point
to //tools:metalc in all targets of this rule type. Alternatively, we could
have named the attribute compiler without the underscore and kept the default
value. This lets users substitute a different compiler if necessary, but
requires no awareness of the compiler's label otherwise.
Every rule requires an implementation function. This function contains the
actual logic of the rule and is executed strictly in the
analysis phase. As such, the function is not
able to actually read or write files. Rather, its main job is to emit
actions that will run later during the execution phase.
Implementation functions take exactly one parameter: a rule
context, conventionally named ctx. It can be used to:
access attribute values and obtain handles on declared input and output files;
create actions; and
pass information to other targets that depend on this one, via providers.
The most common way to access attribute values is by using
ctx.attr.<attribute_name>, though there are several other fields besides
attr that provide more convenient ways of accessing file handles, such as
ctx.file and ctx.outputs. The name and the package of a rule are available
with ctx.label.name and ctx.label.package. The ctx object also contains
some helper functions. See its documentation for a complete
list.
Rule implementation functions are usually private (i.e., named with a leading
underscore) because they tend not to be reused. Conventionally, they are named
the same as their rule, but suffixed with _impl.
See an example of declaring and accessing attributes.
Each call to a build rule returns no value but has the side effect of defining a
new target; this is called instantiating the rule. The dependencies of the new
target are any other targets whose labels are mentioned in its dependency
attributes. In the following example, the target //mypkg:y depends on the
targets //mypkg:x and //mypkg:z.foo.
# //mypkg:BUILD
my_rule(
name = "x",
)
# Assuming that my_rule has attributes "deps" and "srcs",
# of type attr.label_list()
my_rule(
name = "y",
deps = [":x"],
srcs = [":z.foo"],
)
Dependencies are represented at analysis time as Target
objects. These objects contain the information produced by analyzing a target --
in particular, its providers. The current target can access its
dependencies' Target objects within its rule implementation function by using
ctx.attr.
Files are represented by the File type. Since Bazel does not
perform file I/O during the analysis phase, these objects cannot be used to
directly read or write file content. Rather, they are passed to action-emitting
functions to construct pieces of the action graph. See
ctx.actions for the available kinds of actions.
A file can either be a source file or a generated file. Each generated file must be an output of exactly one action. Source files cannot be the output of any action.
Some files, including all source files, are addressable by labels. These files
have Target objects associated with them. If a file's label appears within a
dependency attribute (for example, in a srcs attribute of type
attr.label_list), the ctx.attr.<attr_name> entry for it will contain the
corresponding Target. The File object can be obtained from this Target's
files field. This allows the file to be referenced in both the target graph
and the action graph.
During the analysis phase, a rule's implementation function can create
additional output files. Since all labels have to be known during the loading
phase, these additional output files are not associated with labels or
Targets. Generally these are intermediate files needed for a later compilation
step, or auxiliary outputs that don't need to be referenced in the target graph.
Even though these files don't have a label, they can still be passed along in a
provider to make them available to other depending targets at
analysis time.
A generated file that is addressable by a label is called a predeclared output. There are multiple ways for a rule to introduce a predeclared output:
If the rule declares an outputs dict in its
call to rule(), then each entry in this dict becomes an output. The output's
label is chosen automatically as specified by the entry, usually by
substituting into a string template. This is the most common way to define
outputs.
The rule can have an attribute of type output or
output_list. In this case the user explicitly
chooses the label for the output when they instantiate the rule.
(Deprecated) If the rule is marked
executable or
test, an output is created with the same name
as the rule instance itself. (Technically, the file has no label since it
would clash with the rule instance's own label, but it is still considered a
predeclared output.) By default, this file serves as the binary to run if the
target appears on the command line of a bazel run or bazel test command.
See Executable rules below.
All predeclared outputs can be accessed within the rule's implementation
function under the ctx.outputs struct; see that page
for details and restrictions. Non-predeclared outputs are created during
analysis using the ctx.actions.declare_file
and ctx.actions.declare_directory
functions. Both kinds of outputs may be passed along in providers.
Although the input files of a target -- those files passed through dependency
attributes -- can be accessed indirectly via ctx.attr, it is more convenient
to use ctx.file and ctx.files. For output files that are predeclared using
output attributes (attributes of type attr.output or attr.output_list),
ctx.attr will only return the label, and you must use ctx.outputs to get the
actual File object.
See example of predeclared outputs
An action describes how to generate a set of outputs from a set of inputs, for example "run gcc on hello.c and get hello.o". When an action is created, Bazel doesn't run the command immediately. It registers it in a graph of dependencies, because an action can depend on the output of another action (e.g. in C, the linker must be called after compilation). In the execution phase, Bazel decides which actions must be run and in which order.
All functions that create actions are defined in ctx.actions:
Actions take a set (which can be empty) of input files and generate a (non-empty) set of output files. The set of input and output files must be known during the analysis phase. It might depend on the value of attributes and information from dependencies, but it cannot depend on the result of the execution. For example, if your action runs the unzip command, you must specify which files you expect to be inflated (before running unzip).
Actions are comparable to pure functions: They should depend only on the provided inputs, and avoid accessing computer information, username, clock, network, or I/O devices (except for reading inputs and writing outputs). This is important because the output will be cached and reused.
If an action generates a file that is not listed in its outputs: This is fine, but the file will be ignored and cannot be used by other rules.
If an action does not generate a file that is listed in its outputs: This is an execution error and the build will fail. This happens for instance when a compilation fails.
If an action generates an unknown number of outputs and you want to keep them all, you must group them in a single file (e.g., a zip, tar, or other archive format). This way, you will be able to deterministically declare your outputs.
If an action does not list a file it uses as an input, the action execution will most likely result in an error. The file is not guaranteed to be available to the action, so if it is there, it's due to coincidence or error.
If an action lists a file as an input, but does not use it: This is fine. However, it can affect action execution order, resulting in sub-optimal performance.
Dependencies are resolved by Bazel, which will decide which actions are executed. It is an error if there is a cycle in the dependency graph. Creating an action does not guarantee that it will be executed: It depends on whether its outputs are needed for the build.
Imagine that you want to build a C++ binary and target a different architecture. The build can be complex and involve multiple steps. Some of the intermediate binaries, like the compilers and code generators, have to run on your machine (the host); some of the binaries such the final output must be built for the target architecture.
For this reason, Bazel has a concept of "configurations" and transitions. The topmost targets (the ones requested on the command line) are built in the "target" configuration, while tools that should run locally on the host are built in the "host" configuration. Rules may generate different actions based on the configuration, for instance to change the cpu architecture that is passed to the compiler. In some cases, the same library may be needed for different configurations. If this happens, it will be analyzed and potentially built multiple times.
By default, Bazel builds the dependencies of a target in the same configuration as the target itself, i.e. without transitioning. When a target depends on a tool, the label attribute will specify a transition to the host configuration. This causes the tool and all of its dependencies to be built for the host machine, assuming those dependencies do not themselves have transitions.
For each dependency attribute, you can decide whether the dependency target
should be built in the same configuration, or transition to the host
configuration (using cfg). If a dependency attribute has the flag
executable=True, the configuration must be set explicitly.
See example
In general, sources, dependent libraries, and executables that will be needed at runtime can use the same configuration.
Tools that are executed as part of the build (e.g., compilers, code generators)
should be built for the host configuration. In this case, specify cfg="host"
in the attribute.
Otherwise, executables that are used at runtime (e.g. as part of a test) should
be built for the target configuration. In this case, specify cfg="target" in
the attribute.
Rules may access configuration fragments
such as cpp, java and jvm. However, all required fragments must be
declared in order to avoid access errors:
def _impl(ctx):
# Using ctx.fragments.cpp would lead to an error since it was not declared.
x = ctx.fragments.java
...
my_rule = rule(
implementation = _impl,
fragments = ["java"], # Required fragments of the target configuration
host_fragments = ["java"], # Required fragments of the host configuration
...
)
ctx.fragments only provides configuration fragments for the target
configuration. If you want to access fragments for the host configuration,
use ctx.host_fragments instead.
Providers are pieces of information that a rule exposes to other rules that depend on it. This data can include output files, libraries, parameters to pass on a tool's command line, or anything else the depending rule should know about. Providers are the only mechanism to exchange data between rules, and can be thought of as part of a rule's public interface (loosely analogous to a function's return value).
A rule can only see the providers of its direct dependencies. If there is a rule
top that depends on middle, and middle depends on bottom, then we say
that middle is a direct dependency of top, while bottom is a transitive
dependency of top. In this case, top can see the providers of middle. The
only way for top to see any information from bottom is if middle
re-exports this information in its own providers; this is how transitive
information can be accumulated from all dependencies. In such cases, consider
using depsets to hold the data more efficiently without excessive
copying.
Providers can be declared using the provider() function:
TransitiveDataInfo = provider(fields=["value"])
Rule implementation function can then construct and return provider instances:
def rule_implementation(ctx):
...
return [TransitiveDataInfo(value=5)]
TransitiveDataInfo acts both as a constructor for provider instances and as a key to access them.
A target serves as a map from each provider that the target supports, to the
target's corresponding instance of that provider.
A rule can access the providers of its dependencies using the square bracket notation ([]):
def dependent_rule_implementation(ctx):
...
n = 0
for dep_target in ctx.attr.deps:
n += dep_target[TransitiveDataInfo].value
...
All targets have a DefaultInfo provider that can be used to access
some information relevant to all targets.
Providers are only available during the analysis phase. Examples of usage:
Historically, Bazel providers were simple fields on the Target object. They
were accessed using the dot operator, and they were created by putting the field
in a struct returned by the rule's implementation function.
This style is deprecated and should not be used in new code; see below for information that may help you migrate. The new provider mechanism avoids name clashes. It also supports data hiding, by requiring any code accessing a provider instance to retrieve it using the provider symbol.
For the moment, legacy providers are still supported. A rule can return both legacy and modern providers as follows:
def _myrule_impl(ctx):
...
legacy_data = struct(x="foo", ...)
modern_data = MyInfo(y="bar", ...)
# When any legacy providers are returned, the top-level returned value is a struct.
return struct(
# One key = value entry for each legacy provider.
legacy_info = legacy_data,
...
# All modern providers are put in a list passed to the special "providers" key.
providers = [modern_data, ...])
If dep is the resulting Target object for an instance of this rule, the
providers and their contents can be retrieved as dep.legacy_info.x and
dep[MyInfo].y.
In addition to providers, the returned struct can also take several other
fields that have special meaning (and that do not create a corresponding legacy
provider).
The fields files, runfiles, data_runfiles, default_runfiles, and
executable correspond to the same-named fields of
DefaultInfo. It is not allowed to specify
any of these fields while also returning a DefaultInfo modern provider.
The field output_groups takes a struct value and corresponds to an
OutputGroupInfo.
The field instrumented_files is for
code coverage instrumentation. It does not
yet have a modern provider equivalent. If you need it, you cannot yet migrate
away from legacy providers.
In provides declarations of rules, and in
providers declarations of dependency
attributes, legacy providers are passed in as strings and modern providers are
passed in by their *Info symbol. Be sure to change from strings to symbols
when migrating. For complex or large rule sets where it is difficult to update
all rules atomically, you may have an easier time if you follow this sequence of
steps:
Modify the rules that produce the legacy provider to produce both the legacy and modern providers, using the above syntax. For rules that declare they return the legacy provider, update that declaration to include both the legacy and modern providers.
Modify the rules that consume the legacy provider to instead consume the
modern provider. If any attribute declarations require the legacy provider,
also update them to instead require the modern provider. Optionally, you can
interleave this work with step 1 by having consumers accept/require either
provider: Test for the presence of the legacy provider using
hasattr(target, 'foo'), or the new provider using FooInfo in target.
Fully remove the legacy provider from all rules.
Runfiles are a set of files used by the (often executable) output of a rule during runtime (as opposed to build time, i.e. when the binary itself is generated). During the execution phase, Bazel creates a directory tree containing symlinks pointing to the runfiles. This stages the environment for the binary so it can access the runfiles during runtime.
Runfiles can be added manually during rule creation and/or collected transitively from the rule's dependencies:
def _rule_implementation(ctx):
...
transitive_runfiles = depset(transitive=
[dep.transitive_runtime_files for dep in ctx.attr.special_dependencies])
runfiles = ctx.runfiles(
# Add some files manually.
files = [ctx.file.some_data_file],
# Add transitive files from dependencies manually.
transitive_files = transitive_runfiles,
# Collect runfiles from the common locations: transitively from srcs,
# deps and data attributes.
collect_default = True,
)
# Add a field named "runfiles" to the DefaultInfo provider in order to actually
# create the symlink tree.
return [DefaultInfo(runfiles=runfiles)]
Note that non-executable rule outputs can also have runfiles. For example, a library might need some external files during runtime, and every dependent binary should know about them.
Also note that if an action uses an executable, the executable's runfiles can be used when the action executes.
Normally, the relative path of a file in the runfiles tree is the same as the
relative path of that file in the source tree or generated output tree. If these
need to be different for some reason, you can specify the root_symlinks or
symlinks arguments. The root_symlinks is a dictionary mapping paths to
files, where the paths are relative to the root of the runfiles directory. The
symlinks dictionary is the same, but paths are implicitly prefixed with the
name of the workspace.
...
runfiles = ctx.runfiles(
root_symlinks = {"some/path/here.foo": ctx.file.some_data_file2}
symlinks = {"some/path/here.bar": ctx.file.some_data_file3}
)
# Creates something like:
# sometarget.runfiles/
# some/
# path/
# here.foo -> some_data_file2
# <workspace_name>/
# some/
# path/
# here.bar -> some_data_file3
If symlinks or root_symlinks is used, be careful not to map two different
files to the same path in the runfiles tree. This will cause the build to fail
with an error describing the conflict. To fix, you will need to modify your
ctx.runfiles arguments to remove the collision. This checking will be done for
any targets using your rule, as well as targets of any kind that depend on those
targets.
A single target can have several output files. When a bazel build command is
run, some of the outputs of the targets given to the command are considered to
be requested. Bazel only builds these requested files and the files that they
directly or indirectly depend on. (In terms of the action graph, Bazel only
executes the actions that are reachable as transitive dependencies of the
requested files.)
Every target has a set of default outputs, which are the output files that
normally get requested when that target appears on the command line. For
example, a target //pkg:foo of java_library type has in its default outputs
a file foo.jar, which will be built by the command bazel build //pkg:foo.
Any predeclared output can be explicitly requested on the command line. This can
be used to build outputs that are not default outputs, or to build some but not
all default outputs. For example, bazel build //pkg:foo_deploy.jar and
bazel build //pkg:foo.jar will each just build that one file (along with
its dependencies). See an example
of a rule with non-default predeclared outputs.
In addition to default outputs, there are output groups, which are collections
of output files that may be requested together. For example, if a target
//pkg:mytarget is of a rule type that has a debug_files output group, these
files can be built by running
bazel build //pkg:mytarget --output_groups=debug_files. See the command line
reference
for details on the --output_groups argument. Since non-predeclared outputs
don't have labels, they can only be requested by appearing in the default
outputs or an output group.
You can specify the default outputs and output groups of a rule by returning the
DefaultInfo and
OutputGroupInfo providers from its implementation
function.
def _myrule_impl(ctx):
name = ...
binary = ctx.actions.declare_file(name)
debug_file = ctx.actions.declare_file(name + ".pdb")
# ... add actions to generate these files
return [DefaultInfo(files = depset([binary])),
OutputGroupInfo(debug_files = depset([debug_file]),
all_files = depset([binary, debug_file]))]
These providers can also be retrieved from dependencies using the usual syntax
<target>[DefaultInfo] and <target>[OutputGroupInfo], where <target> is a
Target object.
Note that even if a file is in the default outputs or an output group, you may still want to return it in a custom provider in order to make it available in a more structured way. For instance, you could pass headers and sources along in separate fields of your provider.
A rule can use the instrumented_files provider to provide information about
which files should be measured when code coverage data collection is enabled:
def _rule_implementation(ctx):
...
return struct(instrumented_files = struct(
# Optional: File extensions used to filter files from source_attributes.
# If not provided, then all files from source_attributes will be
# added to instrumented files, if an empty list is provided, then
# no files from source attributes will be added.
extensions = ["ext1", "ext2"],
# Optional: Attributes that contain source files for this rule.
source_attributes = ["srcs"],
# Optional: Attributes for dependencies that could include instrumented
# files.
dependency_attributes = ["data", "deps"]))
ctx.configuration.coverage_enabled notes whether coverage data collection is enabled for the current run in general (but says nothing about which files specifically should be instrumented). If a rule implementation needs to add coverage instrumentation at compile-time, it can determine if its sources should be instrumented with ctx.coverage_instrumented:
# Are this rule's sources instrumented?
if ctx.coverage_instrumented():
# Do something to turn on coverage for this compile action
Note that function will always return false if ctx.configuration.coverage_enabled is
false, so you don't need to check both.
If the rule directly includes sources from its dependencies before compilation
(e.g. header files), it may also need to turn on compile-time instrumentation
if the dependencies' sources should be instrumented. In this case, it may
also be worth checking ctx.configuration.coverage_enabled so you can avoid looping
over dependencies unnecessarily:
# Are this rule's sources or any of the sources for its direct dependencies
# in deps instrumented?
if ctx.configuration.coverage_enabled:
if (ctx.coverage_instrumented() or
any([ctx.coverage_instrumented(dep) for dep in ctx.attr.deps]):
# Do something to turn on coverage for this compile action
Executable rules define targets that can be invoked by a bazel run command.
Test rules are a special kind of executable rule whose targets can also be
invoked by a bazel test command. Executable and test rules are created by
setting the respective executable or
test argument to true when defining the rule.
Test rules (but not necessarily their targets) must have names that end in
_test. Non-test rules must not have this suffix.
Both kinds of rules must produce an executable output file (which may or may not
be predeclared) that will be invoked by the run or test commands. To tell
Bazel which of a rule's outputs to use as this executable, pass it as the
executable argument of a returned DefaultInfo
provider.
The action that generates this file must set the executable bit on the file. For
a ctx.actions.run() or ctx.actions.run_shell() action this should be done by
the underlying tool that is invoked by the action. For a ctx.actions.write()
action it is done by passing the argument is_executable=True.
As legacy behavior, executable rules have a special ctx.outputs.executable
predeclared output. This file serves as the default executable if you do not
specify one using DefaultInfo; it must not be used otherwise. This output
mechanism is deprecated because it does not support customizing the executable
file's name at analysis time.
See examples of an executable rule and a test rule.
Test rules inherit the following attributes: args, flaky, local,
shard_count, size, timeout. The defaults of inherited attributes cannot be
changed, but you can use a macro with default arguments:
def example_test(size="small", **kwargs):
_example_test(size=size, **kwargs)
_example_test = rule(
...
)