Namespace ETLBox.DataFlow

Classes

AggregateColumn

This attribute is used to identify the aggregation property for aggregations.

This attribute defines a column name to which the value of the property is mapped when writing or reading from a database or using the ColumnRename transformation. By default, when reading from a database source the mapping which property stores data of which column is resolved by the property names. Using this attribute, you can specify the column name that maps to a property. In the ColumnRename transformation, this property is used to rename a column.

CompareColumn

This attribute defines if the column is included in the comparison to identify object that exists and needs to be updated. It it supposed to use with an object that either inherits from MergeableRow. If you implement the IMergeable interface, you need to override the Equals-method instead.

DataFlow

Contains static information which affects all Dataflow tasks in ETLBox. Here you can set the threshold value when information about processed records should appear.

DataFlowBatchDestination<TInput>

DataFlowComponent

A base class for data flow components

DataFlowDestination<TInput>

DataFlowExecutableSource<TOutput>

Base implementation for a source that can be executed.

DataFlowJoinTarget<TInput>

A target block base implementation

DataFlowSource<TOutput>

The base implementation for a source component.

DataFlowStreamDestination<TInput>

The base implementation for a destination that allows writing of data in a stream.

DataFlowStreamSource<TOutput>

DataFlowTransformation<TInput, TOutput>

DeleteColumn

This attribute defines if the column is used to identify if the record is supposed to be deleted. If this attribute is set and the given value matches the column of the assigned property, the DbMerge will know that if the records matches (identifed by the IdColumn attribute) it should be deleted.

DistinctColumn

This attribute is used to identify distinct properties in an object.

ErrorSource

Works as a source component for any errors. Another component can use this source to redirect errors into the error data flow.

ETLBoxError

The generic ETLBox Exception. Contains serialized information about the error.

ExcelColumn

This attribute defines either which column index is mapped to the property or the header name that identifies the column By default, when reading from an excel file, a header column is expected in the first row. The name of the header is used to match with the property names of the object. With this attribute, you can define the column index of the excel column for the property or a different header name for a property. The index starts at 0.

ExcelRange

Defines a range in an excel file where the data is located.

GroupColumn

This attribute is used to identify the grouping property for aggregations. The passed column name identifies the property in the aggregation output object.

IdColumn

This attribute defines if the column is used as an Id for the DBMerge. It it supposed to use with an object that either inherits from MergeableRow or implements the IMergeable interface. If you do not provide this attribute, you need to override the UniqueId property if you inherit from MergeableRow.

JoinTarget<TInput>

A target block that serves as a destination for components that can have multiple inputs.

MatchColumn

This attribute defines that this property is used to match with the property of the object used in the Source for a Lookup identified by the given lookupSourcePropertyName.

MemoryCache<TInput, TCache>

MergeableRow

Inherit from this class if you want to use your data object with a DBMerge, but don't want to implement IMergeableRow yourself. You still needs that you have flagged the id properties with the IdColumn attribute and the properties use to identify equal object flagged with the UpdateColumn attribute.

MergeProperties

A list of properties that describe on which the DbMerge can perform which merge operation.

Network

RetrieveColumn

This attribute defines that this property is used to store the lookup value of the property from the object used in the Source for a Lookup identified by the given lookupSourcePropertyName.

StreamMetaData

This class holds meta data about the current progress of the source.

TypeInfo

Used to gather information about used type in the data flow component.

UpdateColumn

This attribute defines if a column is the destination is updated. Use the CompareColumn attribute to define if a row in the source and destination match. If they match, you can use the UpdateColumn to describe which columns are actually updated. This is optional - if you don't provide any update columns, all non id columns are updated.

Interfaces

ICacheManager<TInput, TCache>

IDataFlowBatchDestination

IDataFlowBatchDestination<TInput>

IDataFlowComponent

IDataFlowDestination

IDataFlowDestination<TInput>

IDataFlowExecutableSource

Shared methods for sources that can be executed

IDataFlowExecutableSource<TOutput>

Shared methods for sources that can be executed

IDataFlowLogging

IDataFlowSource

Shared properties of all source components

IDataFlowSource<TOutput>

Shared methods for linking of source components

IDataFlowStreamDestination

Implemented by data flow destinations that allow writing data in a stream

IDataFlowStreamDestination<TInput>

Implemented by data flow destinations that allow writing data in a stream

IDataFlowStreamSource

Implemented by data flow sources that allow reading data from a stream source

IDataFlowStreamSource<TOutput>

Implemented by data flow sources that allow reading data from a stream source

IDataFlowTransformation<TOutput>

Implemented by transformations that can have multiple inputs with different type and one or more outputs of the same type

IDataFlowTransformation<TInput, TOutput>

Implemented by transformations that have one or more inputs of the same type and one or more outputs of the same type

IMergeableRow

Represents table row in destination database for

Enums

ChangeAction

When comparing two data sets regarding their changes, this enumeration describe how they are different- Exists: Both are equal, Insert: This record is inserted, Update: This record is updated, Delete: This record is deleted.

MergeMode

The mode of operation a DbMerge may work in. Full means that source contains all data, NoDeletions that source contains all data but no deletions are executed, Delta means that source has only delta information and deletions are deferred from a particular property and OnlyUpdates means that only updates are applied to the destination.

ResourceType

The type of resource you are using for a streaming source or destination. E.g. you can read Json data from a file or via http from a web service.