Namespace ETLBox.DataFlow
Classes
AggregateColumn
This attribute is used to identify the aggregation property for aggregations.
ColumnMap
This attribute defines a column name to which the value of the property is mapped when writing or reading from a database or using the ColumnRename transformation. By default, when reading from a database source the mapping which property stores data of which column is resolved by the property names. Using this attribute, you can specify the column name that maps to a property. In the ColumnRename transformation, this property is used to rename a column.
CompareColumn
This attribute defines if the column is included in the comparison to identify object that exists and needs to be updated. It it supposed to use with an object that either inherits from MergeableRow. If you implement the IMergeable interface, you need to override the Equals-method instead.
DataFlow
Contains static information which affects all Dataflow tasks in ETLBox. Here you can set the threshold value when information about processed records should appear.
DataFlowBatchDestination<TInput>
DataFlowComponent
A base class for data flow components
DataFlowDestination<TInput>
DataFlowExecutableSource<TOutput>
Base implementation for a source that can be executed.
DataFlowJoinTarget<TInput>
A target block base implementation
DataFlowSource<TOutput>
The base implementation for a source component.
DataFlowStreamDestination<TInput>
The base implementation for a destination that allows writing of data in a stream.
DataFlowStreamSource<TOutput>
DataFlowTransformation<TInput, TOutput>
DeleteColumn
This attribute defines if the column is used to identify if the record is supposed to be deleted. If this attribute is set and the given value matches the column of the assigned property, the DbMerge will know that if the records matches (identifed by the IdColumn attribute) it should be deleted.
DistinctColumn
This attribute is used to identify distinct properties in an object.
ErrorSource
Works as a source component for any errors. Another component can use this source to redirect errors into the error data flow.
ETLBoxError
The generic ETLBox Exception. Contains serialized information about the error.
ExcelColumn
This attribute defines either which column index is mapped to the property or the header name that identifies the column By default, when reading from an excel file, a header column is expected in the first row. The name of the header is used to match with the property names of the object. With this attribute, you can define the column index of the excel column for the property or a different header name for a property. The index starts at 0.
ExcelRange
Defines a range in an excel file where the data is located.
GroupColumn
This attribute is used to identify the grouping property for aggregations. The passed column name identifies the property in the aggregation output object.
IdColumn
This attribute defines if the column is used as an Id for the DBMerge. It it supposed to use with an object that either inherits from MergeableRow or implements the IMergeable interface. If you do not provide this attribute, you need to override the UniqueId property if you inherit from MergeableRow.
JoinTarget<TInput>
A target block that serves as a destination for components that can have multiple inputs.
MatchColumn
This attribute defines that this property is used to match with the property of the object used in the Source for a Lookup identified by the given lookupSourcePropertyName.
MemoryCache<TInput, TCache>
MergeableRow
Inherit from this class if you want to use your data object with a DBMerge, but don't want to implement IMergeableRow yourself. You still needs that you have flagged the id properties with the IdColumn attribute and the properties use to identify equal object flagged with the UpdateColumn attribute.
MergeProperties
A list of properties that describe on which the DbMerge can perform which merge operation.
Network
RetrieveColumn
This attribute defines that this property is used to store the lookup value of the property from the object used in the Source for a Lookup identified by the given lookupSourcePropertyName.
StreamMetaData
This class holds meta data about the current progress of the source.
TypeInfo
Used to gather information about used type in the data flow component.
UpdateColumn
This attribute defines if a column is the destination is updated. Use the CompareColumn attribute to define if a row in the source and destination match. If they match, you can use the UpdateColumn to describe which columns are actually updated. This is optional - if you don't provide any update columns, all non id columns are updated.
Interfaces
ICacheManager<TInput, TCache>
IDataFlowBatchDestination
IDataFlowBatchDestination<TInput>
IDataFlowComponent
IDataFlowDestination
IDataFlowDestination<TInput>
IDataFlowExecutableSource
Shared methods for sources that can be executed
IDataFlowExecutableSource<TOutput>
Shared methods for sources that can be executed
IDataFlowLogging
IDataFlowSource
Shared properties of all source components
IDataFlowSource<TOutput>
Shared methods for linking of source components
IDataFlowStreamDestination
Implemented by data flow destinations that allow writing data in a stream
IDataFlowStreamDestination<TInput>
Implemented by data flow destinations that allow writing data in a stream
IDataFlowStreamSource
Implemented by data flow sources that allow reading data from a stream source
IDataFlowStreamSource<TOutput>
Implemented by data flow sources that allow reading data from a stream source
IDataFlowTransformation<TOutput>
Implemented by transformations that can have multiple inputs with different type and one or more outputs of the same type
IDataFlowTransformation<TInput, TOutput>
Implemented by transformations that have one or more inputs of the same type and one or more outputs of the same type
IMergeableRow
Represents table row in destination database for
Enums
ChangeAction
When comparing two data sets regarding their changes, this enumeration describe how they are different- Exists: Both are equal, Insert: This record is inserted, Update: This record is updated, Delete: This record is deleted.
MergeMode
The mode of operation a DbMerge may work in. Full means that source contains all data, NoDeletions that source contains all data but no deletions are executed, Delta means that source has only delta information and deletions are deferred from a particular property and OnlyUpdates means that only updates are applied to the destination.
ResourceType
The type of resource you are using for a streaming source or destination. E.g. you can read Json data from a file or via http from a web service.