i?1iܵddlmZddlZddlmZmZddlmZmZm Z m Z ddl m Z ddl mZmZddlmZmZer ddlZddlmZGd d eZGd d eZy) ) annotationsN)asynccontextmanagercontextmanager) TYPE_CHECKINGAny AsyncIteratorIterator)ListPage)"filter_out_none_values_recursively ignore_docs)ResourceClientResourceClientAsync)JSONSerializablecJeZdZdZedfd ZddZddddZddZdddddddddddd dd Z d ddddddddd dd Z d dddddddddddddddd ddZ d dddddddddddddddd ddZ e d ddddddddddddddd ddZddZxZS) DatasetClientz-Sub-client for manipulating a single dataset.cL|jdd}t||d|i|y)zInitialize the DatasetClient. resource_pathdatasetsNpopsuper__init__selfargskwargsr __class__s w/home/www/therecruiter.miabetepe.com/venv/lib/python3.12/site-packages/apify_client/clients/resource_clients/dataset.pyrzDatasetClient.__init__, ?J?  $FmFvFc"|jS)Retrieve the dataset. https://docs.apify.com/api/v2#/reference/datasets/dataset/get-dataset Returns: dict, optional: The retrieved dataset, or None, if it does not exist _getrs rgetzDatasetClient.getsyy{r Nnamec>d|i}|jt|S) Update the dataset with specified fields. https://docs.apify.com/api/v2#/reference/datasets/dataset/update-dataset Args: name (str, optional): The new name for the dataset Returns: dict: The updated dataset r(_updater rr(updated_fieldss rupdatezDatasetClient.update$s' D ||>~NOOr c"|jS)nDelete the dataset. https://docs.apify.com/api/v2#/reference/datasets/dataset/delete-dataset _deleter%s rdeletezDatasetClient.delete5s ||~r offsetlimitcleandescfieldsomitunwind skip_empty skip_hiddenflattenviewc |j||||||||| | |  } |jj|jdd| } | j }t |t | jdt | jdt|t | jdt| jdd S)  List the items of the dataset. https://docs.apify.com/api/v2#/reference/datasets/item-collection/get-items Args: offset (int, optional): Number of items that should be skipped at the start. The default value is 0 limit (int, optional): Maximum number of items to return. By default there is no limit. desc (bool, optional): By default, results are returned in the same order as they were stored. To reverse the order, set this parameter to True. clean (bool, optional): If True, returns only non-empty items and skips hidden fields (i.e. fields starting with the # character). The clean parameter is just a shortcut for skip_hidden=True and skip_empty=True parameters. Note that since some objects might be skipped from the output, that the result might contain less items than the limit value. fields (list of str, optional): A list of fields which should be picked from the items, only these fields will remain in the resulting record objects. Note that the fields in the outputted items are sorted the same way as they are specified in the fields parameter. You can use this feature to effectively fix the output format. omit (list of str, optional): A list of fields which should be omitted from the items. unwind (str, optional): Name of a field which should be unwound. If the field is an array then every element of the array will become a separate record and merged with parent object. If the unwound field is an object then it is merged with the parent object. If the unwound field is missing or its value is neither an array nor an object and therefore cannot be merged with a parent object, then the item gets preserved as it is. Note that the unwound items ignore the desc parameter. skip_empty (bool, optional): If True, then empty items are skipped from the output. Note that if used, the results might contain less items than the limit value. skip_hidden (bool, optional): If True, then hidden fields are skipped from the output, i.e. fields starting with the # character. flatten (list of str, optional): A list of fields that should be flattened view (str, optional): Name of the dataset view to be used Returns: ListPage: A page of the list of dataset items according to the specified filters. r6r7r9r8r:r;r< skipEmpty skipHiddenr?r@itemsGETurlmethodparamsx-apify-pagination-totalx-apify-pagination-offsetx-apify-pagination-limitx-apify-pagination-descrFtotalr6countr7r9 _params http_clientcall_urljsonr intheaderslenboolrr6r7r8r9r:r;r<r=r>r?r@request_paramsresponsedatas r list_itemszDatasetClient.list_items<s\ "&  ##(( '"!)  }}X--.HIJh../JKLTX--.HIJX--.GHI    r r r6r7r8r9r:r;r<r=r>c #Kd} d} d} | so| } || |k(ryt| || z } |j|| z| |||||||  }|jEd{t|j}| |z } || krd} | snyy7*wa> Iterate over the items in the dataset. https://docs.apify.com/api/v2#/reference/datasets/item-collection/get-items Args: offset (int, optional): Number of items that should be skipped at the start. The default value is 0 limit (int, optional): Maximum number of items to return. By default there is no limit. desc (bool, optional): By default, results are returned in the same order as they were stored. To reverse the order, set this parameter to True. clean (bool, optional): If True, returns only non-empty items and skips hidden fields (i.e. fields starting with the # character). The clean parameter is just a shortcut for skip_hidden=True and skip_empty=True parameters. Note that since some objects might be skipped from the output, that the result might contain less items than the limit value. fields (list of str, optional): A list of fields which should be picked from the items, only these fields will remain in the resulting record objects. Note that the fields in the outputted items are sorted the same way as they are specified in the fields parameter. You can use this feature to effectively fix the output format. omit (list of str, optional): A list of fields which should be omitted from the items. unwind (str, optional): Name of a field which should be unwound. If the field is an array then every element of the array will become a separate record and merged with parent object. If the unwound field is an object then it is merged with the parent object. If the unwound field is missing or its value is neither an array nor an object and therefore cannot be merged with a parent object, then the item gets preserved as it is. Note that the unwound items ignore the desc parameter. skip_empty (bool, optional): If True, then empty items are skipped from the output. Note that if used, the results might contain less items than the limit value. skip_hidden (bool, optional): If True, then hidden fields are skipped from the output, i.e. fields starting with the # character. Yields: dict: An item from the dataset iFrNrbTminrarFr[)rr6r7r8r9r:r;r<r=r> cache_size should_finish read_itemseffective_limitcurrent_items_pagecurrent_page_item_counts r iterate_itemszDatasetClient.iterate_itemssT    (O &"%j%*2D"E!% *%%'"1 " *// / /&)*<*B*B&C # 1 1J&3 $ 3 & 0sAA=A;'A=9A=rX item_formatr6r7r9r8bom delimiterr:r;r<r=skip_header_rowr>xml_rootxml_rowr?c|tjdtd|j||||||||| | | | | |||S)aBGet the items in the dataset as raw bytes. Deprecated: this function is a deprecated alias of `get_items_as_bytes`. It will be removed in a future version. https://docs.apify.com/api/v2#/reference/datasets/item-collection/get-items Args: item_format (str): Format of the results, possible values are: json, jsonl, csv, html, xlsx, xml and rss. The default value is json. offset (int, optional): Number of items that should be skipped at the start. The default value is 0 limit (int, optional): Maximum number of items to return. By default there is no limit. desc (bool, optional): By default, results are returned in the same order as they were stored. To reverse the order, set this parameter to True. clean (bool, optional): If True, returns only non-empty items and skips hidden fields (i.e. fields starting with the # character). The clean parameter is just a shortcut for skip_hidden=True and skip_empty=True parameters. Note that since some objects might be skipped from the output, that the result might contain less items than the limit value. bom (bool, optional): All text responses are encoded in UTF-8 encoding. By default, csv files are prefixed with the UTF-8 Byte Order Mark (BOM), while json, jsonl, xml, html and rss files are not. If you want to override this default behavior, specify bom=True query parameter to include the BOM or bom=False to skip it. delimiter (str, optional): A delimiter character for CSV files. The default delimiter is a simple comma (,). fields (list of str, optional): A list of fields which should be picked from the items, only these fields will remain in the resulting record objects. Note that the fields in the outputted items are sorted the same way as they are specified in the fields parameter. You can use this feature to effectively fix the output format. omit (list of str, optional): A list of fields which should be omitted from the items. unwind (str, optional): Name of a field which should be unwound. If the field is an array then every element of the array will become a separate record and merged with parent object. If the unwound field is an object then it is merged with the parent object. If the unwound field is missing or its value is neither an array nor an object and therefore cannot be merged with a parent object, then the item gets preserved as it is. Note that the unwound items ignore the desc parameter. skip_empty (bool, optional): If True, then empty items are skipped from the output. Note that if used, the results might contain less items than the limit value. skip_header_row (bool, optional): If True, then header row in the csv format is skipped. skip_hidden (bool, optional): If True, then hidden fields are skipped from the output, i.e. fields starting with the # character. xml_root (str, optional): Overrides default root element name of xml output. By default the root element is items. xml_row (str, optional): Overrides default element name that wraps each page or page function result object in xml output. By default the element name is item. flatten (list of str, optional): A list of fields that should be flattened Returns: bytes: The dataset items as raw bytes za`DatasetClient.download_items()` is deprecated, use `DatasetClient.get_items_as_bytes()` instead.) stacklevelrn)warningswarnDeprecationWarningget_items_as_bytes)rror6r7r9r8rprqr:r;r<r=rrr>rsrtr?s rdownload_itemszDatasetClient.download_itemssd|  o  &&#!+#!'  r c|j||||||||| | | | | |||}|jj|jdd|d}|jS) Get the items in the dataset as raw bytes. https://docs.apify.com/api/v2#/reference/datasets/item-collection/get-items Args: item_format (str): Format of the results, possible values are: json, jsonl, csv, html, xlsx, xml and rss. The default value is json. offset (int, optional): Number of items that should be skipped at the start. The default value is 0 limit (int, optional): Maximum number of items to return. By default there is no limit. desc (bool, optional): By default, results are returned in the same order as they were stored. To reverse the order, set this parameter to True. clean (bool, optional): If True, returns only non-empty items and skips hidden fields (i.e. fields starting with the # character). The clean parameter is just a shortcut for skip_hidden=True and skip_empty=True parameters. Note that since some objects might be skipped from the output, that the result might contain less items than the limit value. bom (bool, optional): All text responses are encoded in UTF-8 encoding. By default, csv files are prefixed with the UTF-8 Byte Order Mark (BOM), while json, jsonl, xml, html and rss files are not. If you want to override this default behavior, specify bom=True query parameter to include the BOM or bom=False to skip it. delimiter (str, optional): A delimiter character for CSV files. The default delimiter is a simple comma (,). fields (list of str, optional): A list of fields which should be picked from the items, only these fields will remain in the resulting record objects. Note that the fields in the outputted items are sorted the same way as they are specified in the fields parameter. You can use this feature to effectively fix the output format. omit (list of str, optional): A list of fields which should be omitted from the items. unwind (str, optional): Name of a field which should be unwound. If the field is an array then every element of the array will become a separate record and merged with parent object. If the unwound field is an object then it is merged with the parent object. If the unwound field is missing or its value is neither an array nor an object and therefore cannot be merged with a parent object, then the item gets preserved as it is. Note that the unwound items ignore the desc parameter. skip_empty (bool, optional): If True, then empty items are skipped from the output. Note that if used, the results might contain less items than the limit value. skip_header_row (bool, optional): If True, then header row in the csv format is skipped. skip_hidden (bool, optional): If True, then hidden fields are skipped from the output, i.e. fields starting with the # character. xml_root (str, optional): Overrides default root element name of xml output. By default the root element is items. xml_row (str, optional): Overrides default element name that wraps each page or page function result object in xml output. By default the element name is item. flatten (list of str, optional): A list of fields that should be flattened Returns: bytes: The dataset items as raw bytes formatr6r7r9r8rprqr:r;r<rD skipHeaderRowrExmlRootxmlRowr?rFrGFrIrJrKparse_responserTrUrVrWcontentrror6r7r9r8rprqr:r;r<r=rrr>rsrtr?r^r_s rr{z DatasetClient.get_items_as_bytes/sx )"!& &##(( '"! ) r ror6r7r9r8rprqr:r;r<r=rrr>rsrtc#Kd} |j||||||||| | | | | ||}|jj|jdd|dd}||r|j yy#|r|j wwxYwwa Retrieve the items in the dataset as a stream. https://docs.apify.com/api/v2#/reference/datasets/item-collection/get-items Args: item_format (str): Format of the results, possible values are: json, jsonl, csv, html, xlsx, xml and rss. The default value is json. offset (int, optional): Number of items that should be skipped at the start. The default value is 0 limit (int, optional): Maximum number of items to return. By default there is no limit. desc (bool, optional): By default, results are returned in the same order as they were stored. To reverse the order, set this parameter to True. clean (bool, optional): If True, returns only non-empty items and skips hidden fields (i.e. fields starting with the # character). The clean parameter is just a shortcut for skip_hidden=True and skip_empty=True parameters. Note that since some objects might be skipped from the output, that the result might contain less items than the limit value. bom (bool, optional): All text responses are encoded in UTF-8 encoding. By default, csv files are prefixed with the UTF-8 Byte Order Mark (BOM), while json, jsonl, xml, html and rss files are not. If you want to override this default behavior, specify bom=True query parameter to include the BOM or bom=False to skip it. delimiter (str, optional): A delimiter character for CSV files. The default delimiter is a simple comma (,). fields (list of str, optional): A list of fields which should be picked from the items, only these fields will remain in the resulting record objects. Note that the fields in the outputted items are sorted the same way as they are specified in the fields parameter. You can use this feature to effectively fix the output format. omit (list of str, optional): A list of fields which should be omitted from the items. unwind (str, optional): Name of a field which should be unwound. If the field is an array then every element of the array will become a separate record and merged with parent object. If the unwound field is an object then it is merged with the parent object. If the unwound field is missing or its value is neither an array nor an object and therefore cannot be merged with a parent object, then the item gets preserved as it is. Note that the unwound items ignore the desc parameter. skip_empty (bool, optional): If True, then empty items are skipped from the output. Note that if used, the results might contain less items than the limit value. skip_header_row (bool, optional): If True, then header row in the csv format is skipped. skip_hidden (bool, optional): If True, then hidden fields are skipped from the output, i.e. fields starting with the # character. xml_root (str, optional): Overrides default root element name of xml output. By default the root element is items. xml_row (str, optional): Overrides default element name that wraps each page or page function result object in xml output. By default the element name is item. Returns: httpx.Response: The dataset items as a context-managed streaming Response N)rr6r7r9r8rprqr:r;r<rDrrErrrFrGTF)rIrJrKstreamr)rTrUrVrWcloserror6r7r9r8rprqr:r;r<r=rrr>rsrtr_r^s r stream_itemszDatasetClient.stream_itemssv !!\\"#$-& *N$'',,IIg&%$ -HN x sBAA-B-BBcd}d}t|tr|}n|}|jj|j ddddi|j ||yaPush items to the dataset. https://docs.apify.com/api/v2#/reference/datasets/item-collection/put-items Args: items: The items which to push in the dataset. Either a stringified JSON, a dictionary, or a list of strings or dictionaries. NrFPOSTz content-typezapplication/json; charset=utf-8)rIrJrZrKr`rX isinstancestrrUrVrWrTrrFr`rXs r push_itemszDatasetClient.push_itemssb eS !DD  '"#%FG<<>  r )rrrrrrreturnNone)rrr dict | None)rrr( str | Nonerdict)rrrr)rrr6 int | Noner7rr8 bool | Noner9rr:list[str] | Noner;rr<rr=rr>rr?rr@rrr )rrr6rYr7rr8rr9rr:rr;rr<rr=rr>rrzIterator[dict])$rrrorr6rr7rr9rr8rrprrqrr:rr;rr<rr=rrrrr>rrsrrtrr?rrbytes)"rrrorr6rr7rr9rr8rrprrqrr:rr;rr<rr=rrrrr>rrsrrtrrzIterator[httpx.Response])rrrFrrr)__name__ __module__ __qualname____doc__r rr&r/r4rarmr|r{rrr __classcell__rs@rrrs7GG ;?P"" ! #'!%!"&#'$(M M M  M  M  M !M M M  M !M "M M  M d ! #'!%!"&#'K%K%K% K%  K%  K%!K%K%K% K%!K% K%`"!  ! $#'!%!"&'+#'#"$(%U U U  U  U  U U U U !U U U  U %U !U !U "#U $"%U & 'U t"!  ! $#'!%!"&'+#'#"$(%V V V  V  V  V V V V !V V V  V %V !V !V "#V $"%V & 'V p"!  ! $#'!%!"&'+#'#"#X!X!X! X!  X!  X!X!X!X!!X!X!X! X!%X!!X! !X!"#X!$ "%X!X!t r rceZdZdZedfd ZddZddddZddZdddddddddddd dd Z d ddddddddd dd Z d dddddddddddddddd ddZ e d ddddddddddddddd ddZ ddZxZS)DatasetClientAsyncz3Async sub-client for manipulating a single dataset.cL|jdd}t||d|i|y)z"Initialize the DatasetClientAsync.rrNrrs rrzDatasetClientAsync.__init__rr c>K|jd{S7w)r"Nr#r%s rr&zDatasetClientAsync.getsYY[   Nr'cZKd|i}|jt|d{S7w)r*r(Nr+r-s rr/zDatasetClientAsync.updates1 D \\"D^"TUUUUs "+)+c>K|jd{S7w)r1Nr2r%s rr4zDatasetClientAsync.delete s \\^###rr5c K|j||||||||| | |  } |jj|jdd| d{} | j }t |t | jdt | jdt|t | jdt| jd d S7w) rBrCrFrGrHNrLrMrNrOrPrSr]s rrazDatasetClientAsync.list_items's\ "&  )).. '"!/   }}X--.HIJh../JKLTX--.HIJX--.GHI     sA CCBCrrbc Kd} d} d} | sy| } || |k(ryt| || z } |j|| z| |||||||  d{}|jD]}| t|j}| |z } || krd} | sxyy7@wrdre)rr6r7r8r9r:r;r<r=r>rgrhrirjrkitemrls rrmz DatasetClientAsync.iterate_itemsvsT    (O &"%j%*2D"E'+ *%%'(7 ( " +00   '**<*B*B&C # 1 1J&3 $ 5  "sABB=BBrXrncK|j||||||||| | | | | |||}|jj|jdd|dd{}|jS7w)r~rrFrGFrNrrs rr{z%DatasetClientAsync.get_items_as_bytessx )"!& &)).. '"! /   sAA(A&A(rcJKd} |j||||||||| | | | | ||}|jj|jdd|ddd{}||r|j d{yy7%7#|r|j d{7wwxYwwr)rTrUrVrWaclosers rrzDatasetClientAsync.stream_itemssv (!\\"#$-& *N$"--22IIg&%$ 3HNoo'''(oo'''sMB#ABA> B"B#7B8B#>BB#B BB  B#cKd}d}t|tr|}n|}|jj|j ddddi|j ||d{y7wrrrs rrzDatasetClientAsync.push_itemswsp eS !DD## '"#%FG<<> $   sAA'A% A')rrrrrrrr)rrrr)rrr(rrr)rrrr)rrr6rr7rr8rr9rr:rr;rr<rr=rr>rr?rr@rrr )rrr6rYr7rr8rr9rr:rr;rr<rr=rr>rrzAsyncIterator[dict])$rrrorr6rr7rr9rr8rrprrqrr:rr;rr<rr=rrrrr>rrsrrtrr?rrr)"rrrorr6rr7rr9rr8rrprrqrr:rr;rr<rr=rrrrr>rrsrrtrrzAsyncIterator[httpx.Response])rrrFrrr)rrrrr rr&r/r4rarmr{rrrrrs@rrrs=GG !FJV"$" ! #'!%!"&#'$(M  M M  M  M  M !M M M  M !M "M M  M d ! #'!%!"&#'L% L%L% L%  L%  L%!L%L%L% L%!L% L%b"!  ! $#'!%!"&'+#'#"$(%V  V V  V  V  V V V V !V V V  V %V !V !V "#V $"%V & 'V p"!  ! $#'!%!"&'+#'#"#X( X(X( X(  X(  X(X(X(X(!X(X(X( X(%X(!X( !X("#X($ '%X(X(t r r) __future__rrx contextlibrrtypingrrrr apify_shared.modelsr apify_shared.utilsr r apify_client.clients.baser rhttpxapify_shared.typesrrrr rrsD":>>(NI3h Nh VR ,R r