Interface IDataFlowStreamSource

Implemented by data flow sources that allow reading data from a stream source

Namespace: ETLBox.DataFlow

Assembly: ETLBox.dll

Syntax

public interface IDataFlowStreamSource

Properties

GetNextUri

This func returns the next url that is used for reading data. It will be called until HasNextUri returns false. The incoming StreamMetaData holds information about the current progress and other meta data from the response, like unparsed json data that contains references to the next page of the response. This property can be used if you want to read multiple files or if you want to paginate through web responses.

Declaration

Func<StreamMetaData, string> GetNextUri { get; set; }

Property Value

Type	Description
System.Func<StreamMetaData, System.String>

HasNextUri

This func determines if another request is started to read additional data from the next uri. StreamMetaData has information about the current progress and other meta data from the response.

Declaration

Func<StreamMetaData, bool> HasNextUri { get; set; }

Property Value

Type	Description
System.Func<StreamMetaData, System.Boolean>

HttpClient

The System.Net.Http.HttpClient uses for the request. Use this client if you want to add or change the http request data, e.g. you can add your authorization information here.

Declaration

HttpClient HttpClient { get; set; }

Property Value

Type	Description
System.Net.Http.HttpClient

HttpRequestMessage

The System.Net.Http.HttpRequestMessage use for the request from the HttpClient. Add your request message here, e.g. your POST body.

Declaration

HttpRequestMessage HttpRequestMessage { get; set; }

Property Value

Type	Description
System.Net.Http.HttpRequestMessage

ResourceType

Specifies the resource type. By default requests are made with HttpClient. Specify ResourceType.File if you want to read from a json file.

Declaration

ResourceType ResourceType { get; set; }

Property Value

Type	Description
ResourceType

Uri

The Url of the webservice (e.g. https://test.com/foo) or the file name (relative or absolute).

Declaration

string Uri { get; set; }

Property Value

Type	Description
System.String