* [#417] feat: added playwright reactors
* [#417] feat: updated playwright reactors
* [#417] feat: updated playwright reactors
* [#417] feat: added variable record with isPassword field
* [#417] feat: fixed playwright variables not retrieved when text is empty
* [#417] feat: added replayStep reactor
* [#417] fix: fix replayStep loop
* feat: list all recording
* [#417] feat: Added click, navigate, wait, scroll to replayStep reactor
* feat: ProbeElement Reactor
Signed-off-by: RawanAbdelkhalek <66391994+RawanAbdelkhalek@users.noreply.github.com>
* [#465] feat: Added cropped screenshot and LLM Context reactor
* [#465] feat: Return probe in action list in ReplayStepReactor
* [#417] fix: fixed isLastPage + always add naviage step in separate array
* fix(playwright): replace the text value when deleting instead of appending
* [#417] fix: fixed executeAll logic
* [#465] Return probe data in action list for Type steps
* fix(playwright): int check for strings in probeReactor
* feat: Add playwright utils
* feat: HTML Extraction & LLM Step Generation
* [1235] - feat - Add JSON structured support for Anthropic and Bedrock Clients. (#1259)
* [1235] - feat - Added the support for JSON structured responses for Anthropic and Bedrock Clients.
* [1235] - feat - standardized the code.
* [1235] - feat - included the script to standardize the response of bedrock and anthropic clients for JSON structured.
* [1239] - feat - Added the new message format support for AzureOpenAiChatCompletion and AzureOpenAIResponses through OpenAiClientV2 class. (#1267)
Co-authored-by: Ryan Weiler <ryanweiler92@gmail.com>
* feat: update model urls (#1271)
* fix: modification for processing java to python string (#1270)
* Reduce Clauses in Bool OpenSearch (#1268)
* fix: reduce clauses in bool
* fix: terms
* fix: comparator
* fix: pixeldatatype
* fix: casting to number to get long value (#1276)
* fix-casting-modellogs-2 (#1277)
* feat: exposing ability to generate mcp for just a single tool that gets appended (instead of replacing) the current mcp json (#1280)
* feat: exposing ability to generate mcp for just a single tool that gets appended (instead of replacing) the current mcp json
* fix: proper error messages for the expected file
* feat: exposing admin reactor to view RDF contents (#1274)
* added code for masking Sensitive data in RDF Map prop file
* feat: added code for masking RDF Map sensitive data
* chore: moving methods to DIHelper directly instead of Utility
* chore: renaming reactor and adding description
---------
Co-authored-by: Varaham <katchabi50@gmail.com>
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* [1266] - feat - Support beta headers for the Python Anthropic Client (#1281)
* [1266] - feat - Added the support to Anthropic client for the beta headers to support the large documents.
* [1266] - feat - Updated the code.
* feat: handle betas with streaming legacy messages
---------
Co-authored-by: Ryan Weiler <ryanweiler92@gmail.com>
* Don't require beta headers param for anthropic models (#1282)
* feat: don't require beta headers param for anthropic models
* feat: update use_beta_header typing
* feat: adding log4j2.xml and new appenders to log into audit database (#1208)
* feat: creation of the audit logs db on startup to hold both the server logs and the engine method logs performed through PipelineInvocationHandler
* feat: enabling log4j2.xml at the engine level within the assets folder to separate out logs. Example could be
<?xml version="1.0" encoding="UTF-8"?>
<Configuration xmlns:xi="http://www.w3.org/2001/XInclude" xmlns="https://logging.apache.org/xml/ns"
status="INFO"
packages="prerna.logging"
monitorInterval="30">
<Appenders>
<!-- Console Appender -->
<Console name="Console" target="SYSTEM_OUT">
<PatternLayout>
<!-- <Pattern>[%-5level] %d{yyyy-MM-dd HH:mm:ss} %c{1.}:%L [user=%X{userId}] [session=%X{sessionId}] [ip=%X{clientIP}] %m%n</Pattern> -->
<Pattern>CUSTOM_ENGINE [%-5level] %d{yyyy-MM-dd HH:mm:ss} %c{1.}:%L [user=%X{userId}] %m%n</Pattern>
</PatternLayout>
</Console>
<!-- Database Appender -->
<ServerLogsJDBCAppender name="ServerLogsJDBCAppender" batchSize="1" ignoreExceptions="false">
<PatternLayout>
<Pattern>CUSTOM_ENGINE [%-5level] %d{yyyy-MM-dd HH:mm:ss} %c{1.}:%L [user=%X{userId}] [session=%X{sessionId}] [ip=%X{clientIP}] [reqId=%X{requestId}] %m%n</Pattern>
</PatternLayout>
</ServerLogsJDBCAppender>
<AuditLogsJDBCAppender name="AuditLogsJDBCAppender" batchSize="1" ignoreExceptions="false" engineId="11629219-1fbf-4b52-af2a-04b509b2f111">
<PatternLayout>
<Pattern>CUSTOM_ENGINE [%-5level] %d{yyyy-MM-dd HH:mm:ss} %c{1.}:%L [user=%X{userId}] [session=%X{sessionId}] [ip=%X{clientIP}] [reqId=%X{requestId}] %m%n</Pattern>
</PatternLayout>
</AuditLogsJDBCAppender>
</Appenders>
<Loggers>
<AsyncLogger name="EngineLogger" level="INFO" additivity="false" includeLocation="false">
<AppenderRef ref="AuditLogsJDBCAppender" />
<AppenderRef ref="Console" />
<AppenderRef ref="ServerLogsJDBCAppender" />
</AsyncLogger>
<AsyncRoot level="WARN" includeLocation="false">
<AppenderRef ref="Console" />
</AsyncRoot>
</Loggers>
</Configuration>
---------
Co-authored-by: US\pkapaleeswaran <pkapaleeswaran@deloitte.com>
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
Co-authored-by: Magudapathy <pmagudapathy@deloitte.com>
* feat: exposing admin only checks on guardrails (#1286)
* feat: exposing admin only checks on guardrails
* chore: adding admin values for guardrails in rdf_map
* chore: adding secrets for guardrails
* feat: mcp notebook will now replace the python function in the driver python file if there is an existing mcp tool that has that cell id in its meta (#1288)
* Fix upload issue with proper cleanup from DIHelper (#1272)
* fix: fix database file lock issue
* fix: removing engine from DIHelper
* fix: applying fix on upload of projects, removing db logic
---------
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* fix-remove-microservice-url in RDF (#1291)
* fix: switch from athena simba jar to aws jar (#1293)
* chore: switching code creation to text block instead of concatenations (#1294)
* fix: adding plugin to remove log4j from athena fat jar (#1297)
* fix: eclipse runs with a specific class loader, need changes to ensure it works for development (#1298)
* Upgrading Python Packages (#1295)
* feat: upgrading faiss-cpu && numpy
* feat: upgrading openai, anthropic, googlegenai, pydantic adding langextract
---------
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* chore: removing deprecated plugin lookup attribute (#1299)
* chore: remove aws v1 sdk (#1300)
* chore: removing old aws jars and s3 custom reactors - use storage reactors instead
* chore: ignoring dependency-reduced-pom.xml
* fix: delete classes associated with aws v1 code that was removed (#1302)
* fix throw query errors (#1304)
* feat: adding logic for custom groups, formatting security util code, try-catch-finally to try-with-resource (#1220)
---------
Co-authored-by: Anurag Jain <anurag91jain@gmail.com>
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* chore: switching to try-with-resource (#1305)
* feat: google ocr, aws textract, pom dependency updates (#1189)
* feat: exposing new OCR routines that can be integrated with vector databases
* feat: removing com.microsoft.azure jars (legacy v1) for com.azure jars
* chore: removing slf4j logger factory for log4j log manager
* feat: deprecating CreateRestFunctionEngineReactor for CreateFunctionEngineReactor
* chore: with introduction of new jars and dependencies growing, modified plugin to require 100% dependency convergence. generate report by running:
mvn project-info-reports:dependency-convergence
---------
Co-authored-by: kavks <Kavks@deloitte.com>
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* chore: exposing mvn site to get dependency list and dependency coverage (#1306)
* chore: updating jars, switching scheduler to hikari from c3p0 (#1307)
* [1232] - feat - Add Bedrock support through Anthropic's SDK (#1285)
* [1232] - feat - added the bedrock support through anthropic's sdk.
* [1232] - feat - Standardize the code.
* feat: instantiate anthropic bedrock client in anthropic class instead of google
* feat: removing ref to bedrock client in google client class
---------
Co-authored-by: Ryan Weiler <ryanweiler92@gmail.com>
* fix: installing gliner (#1311)
* Mesage table structure rework message (#1195)
* fix: add transaction id column
* fix: message table structure for new messages
* fix: compilation
* fix: update old rooms
* fix: other entry points
* fix: theoretically good
* fix: updation
* fix: extra uuid
* fix: other things
* fix: using message id from AbstractMessage
* fix: imports
* fix: migrate ids and overload doRecordMessage
---------
Co-authored-by: Tejas Lokeshrao <tlokeshrao@deloitte.com>
Co-authored-by: rithvik-doshi <81876806+rithvik-doshi@users.noreply.github.com>
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* feat: switching to new mcp_driver notebook and mcp_driver.py from smss_driver and smss_driver.py (#1309)
* feat: switching from UUID to GUID.v7() (#1314)
* OpenAI transcription function engine (#1284)
* feat: openai transcription function engine
* feat: wip
* feat: OpenAI Transcribe Function Engine
* Cot playground (#1290)
* fix: create step class
* feat: add cotroomreactor outline
* chore: separating playground items
* feat: adding initial cot room
* feat: update updateroomoptionsreactor with other version
* fix: multiple vec db
* fix: correct keyargs
* feat: update room in memory with options
* feat: tools in room options
* fix: pushing cot changes
* fix: check type on python to handle list strs
* fix: proper json return for complex data type
* feat: add step class and adjust cot templates accordingly
* fix: small comment for util
* fix: partial refactor of step class
* feat: finish refactor of step class
* fix: move success criteria to seperate class and consolidate builders
* feat: add prompts to utils
* reverting prompt structure
* fix: triple quote strings incase they have quotes
* feat: create triage reactor
* feat: modify output configuration
* fix: import file
---------
Co-authored-by: Scott <seascott@deloitte.com>
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* fix: using the same parent id for multiple tool inputs (#1315)
* feat: using tool names as enums for cot (#1316)
* fix: using anyOf and sending proper map to python (#1317)
* feat(function): updated to only process files checked for dependencies (#1313)
* feat(function): updated to only go through files which it has checked for dependencies
* feat(function): made minor changes
* chore: formatting code
---------
Co-authored-by: Kumari <skumari40@deloitte.com>
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* feat: openai image models compatible with semoss mssg format (#1318)
* model logs search (#1133)
* fix: model logs search
* fix: remove unused imports
* fix: remove print
* fix: casing
* fix: cast to clob
* varchar
* fix: qs minus lower
* fix: qs
* fix: active rooms
* fix: more in return
* we did it
* chain inner selectors instead
* Update ModelInferenceLogsUtils.java
Remove print
* feat: adding search room reactor
* fix: merge issues
* fix: expand to cover more db options
* remove extra selector
* get rid of other stuff too
* remove unused imports
* comment
---------
Co-authored-by: Van Buren <tevanburen@deloitte.com>
Co-authored-by: Rithvik Doshi <doshirithvik@gmail.com>
Co-authored-by: rithvik-doshi <81876806+rithvik-doshi@users.noreply.github.com>
Co-authored-by: kunal0137 <kunal0137@gmail.com>
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* chore: adding codeowners file (#1319)
* chore: moving function logic to query util class, deprecating UpdateQueryStruct (#1321)
* feat: exposing methods on interface instead of casting IModelEngine to AbstractModelEngine (#1324)
* fix: adding PyUtils.pyEnabled() check to InsightUtility before attempting removeInsightGlobals() (#1322)
Co-authored-by: kunal0137 <kunal0137@gmail.com>
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* fix: correcting timestamp used for token usage query (#1328)
* update databricks jar for arrow changes (#1329)
update databricks jar for arrow changes
* chore: push log4j plugins into resources folder for eclipse to pickup during development (#1330)
* fix: handle types in python syntax (#1331)
* chore: ignore log4j plugin (#1332)
* Handle tool_choice param in Python AI provider clients (#1323)
* feat: google gen ai tool_choice
* feat: support anthropic tool_choice
* feat: google gen ai - dont pass tool config if tools empty
* feat: bedrock tool_choice support
* fix: mcp generation, tools with complex types using openai, calls to google without tools (#1334)
* fix: properly creating the mcp json types and adding in output schema
* fix: accounting for complex mcp types to openai types
* fix: messages breaking when [] array of tools being passed
* fix: removing outputSchema since it seems to not be supported yet by some mcp clients
* feat: new create guardrail engine, consolidating repeated code to UploadUtilities (#1335)
* feat: audit database is now a temp engine instead of direct connection (#1336)
* feat: if the proxy is ever invoked, we will always log even if no input/output reactors (#1337)
* feat: switch from uuid to guidv7 (#1338)
* feat: log4j plugin to mask confidential information, pom update for log4j plugin to recompile even if cached on system (#1341)
* feat: Masking confidential information in the console logs and the rolling appender log files by using log4j2.LogEventPatternConverter
* feat: force compilation of log4j plugin, exposing additional regex pattern matches, moving values to mask into central location
---------
Co-authored-by: Magudapathy <pmagudapathy@deloitte.com>
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* fix: remove inner avro from hadoop jar (#1345)
* fix: shade jar properly excludes conflicts from hadoop and athena (#1350)
* feat: reporting from audit logs (#1287)
* feat: adding in initial logic for reporting from audit logs
* feat: Changes made for fetching Timeline audit log data
* feat: modifying sql interpreter to push to query util for syntax generation of functions, changing name of AuditLog to AuditLogReport
* chore: clearer else if logic on getting the message data if Object vs Map message
* fix: query logic handles null/empty and does all filters as additions, returning all logs even if response/request is empty
---------
Co-authored-by: Magudapathy <pmagudapathy@deloitte.com>
* Add step to install playwright dependencies (#1355)
Co-authored-by: kunal0137 <kunal0137@gmail.com>
* fix: better handling of classpath to compile java (#1358)
* fix: better handling of classpath to compile java
* fix: using StandardCharsets instead of string utf-8
* fix: removing tools from param map if empty (#1361)
* fix: replace old smss_driver.py file name to new mcp_driver.py file name (#1364)
* fix: replace old smss_driver.py file name to new mcp_driver.py file name
* fix: wrapping concat strings in quotes for proper replacement
* chore: switch from string utf-8 to StandardCharsets.UTF_8 (#1365)
* Update anthropic_text_client.py (#1367)
* feat: improved streaming from python models to tomcat (#1366)
* feat: exposing new smss_stream_func in handle python to send back different operation type for streaming chunks from python models
to tomcat. consolidating methods into MCPUtility for processing tools
* chore: fixing typo in comment
* fix: making the PixelJobManager streaming thread safe
* chore: switch streaming logs to debug (#1368)
* fix: aggregating tools in semoss format, handling empty arguments (#1369)
* chore: removing import that is not used (#1370)
* chore: adding commented out method to set smss_stream when running code outside of gaas_tcp_server_handler (#1371)
* fix: resolving error with importing logger which was removed (#1372)
* fix-mcp-utility-functionName (#1374)
* fix: adding pom.properties into shaded meta-inf resolving version error on containers (#1378)
* Retrieve existing message feedback (#1118)
* refactoring message feedback init
* fix illegal start of exp
* simplify query
* pass feedback when getting messages
* extract method
* changing back to messageid and shifting loading feedback to setMessages
* getting elsa feedback almost works
* refactor
* clean up prints
* to string
* refactoring and standard return
* only add feedback if there's something to add
* moving to message utils
* Update BaseFeedback.java
* tried to clean up a bit
* renamed
* unused imports
* unused import
* feat: refactor slightly to avoid breaking error
* fix(refactor): remove ifeedback
* refactor: rename to MessageFeedback
* move parseMessage calls to account for cached vals or unnecessary calls
* only parse again after migration
* remove unnecessary parseMessages
* fix: failing when messageIds null or empty
* fix: update message json
* fix: start flushing messages to room table, add feedback directly to room in room hash + more fixes to feedback
* refactor: unused import
* switch to semoss date
* remove unused deps
* Update Room.java
Remove comment
---------
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
Co-authored-by: kunal0137 <kunal0137@gmail.com>
Co-authored-by: Tejas Lokeshrao <tlokeshrao@deloitte.com>
* Workspace user perm (#1356)
* fix: workspace permissions when shared
* fix: workspace sharing
* fix: move duplicated monolith endpoint call to Security helper
* fix: workspace ownership
* fix: permission not permissions
* fix: logic error
* fix: move existing dependencies over when shared
* fix: comment for helper
* fix: remove unused method
* fix: unused import
* fix: remove unused method param
* fix: remove param from javadoc comment
* fix: authorization check prior to dependency deletion
* fix: editors on project can remove dependencies since they can add them
---------
Co-authored-by: kunal0137 <kunal0137@gmail.com>
* Adjust COT plan id and limit tool choice options (#1382)
* fix: BE created plan id; added COT ornament
* fix: removing some tool choice options
* feat: add step name to schema and correct required fields
---------
Co-authored-by: Scott <seascott@deloitte.com>
* fix: using the new utils (#1383)
* feat: adding confirm cot reactor (#1384)
* [1342] - feat - Tool Choice for OpenAI Chat-Completion and Responses client (#1351)
* [1342] - feat - Added Tool Choice for OpenAI Chat-Completion and Responses client.
* [1342] - feat - Updated the code.
---------
Co-authored-by: Ryan Weiler <ryanweiler92@gmail.com>
* feat: exposing api_endpoint parameter (#1385)
* Unit testing updates (#1303)
* test: fixed unit tests
* test: fixed issue found while fixing unit tests
* test: fixing tests after merging latest dev
* test: removing mockito inline resource
* test: mvn test now runs unit tests with coverage
* chore: fix whitespace showing entire file as diff
---------
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* chore: removing legacy tests (#1389)
* feat: proper streaming (content and tools) with new OpenAI client (#1391)
* feat: extending streaming for chat completions on openai_client_v2, passing cpw into NativePySocketClient to call shutdown on disconnect to release port lock
* chore: using correct gson import
* chore: unit test fixes (#1390)
Co-authored-by: Ryan Weiler <ryanweiler92@gmail.com>
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* fix: passing in correct tool_choice args across models (#1393)
* feat: allowing tools to be added to AskCOT
---------
Co-authored-by: Kunal Patel <kunal0137@gmail.com>
Co-authored-by: Scott <seascott@deloitte.com>
* test(unit): unit tests for prerna.algorithm.learning packages (#659)
* test(unit): unit tests for prerna.algorithm.learning packages
* Merge branch 'dev' into 569-unit-test-for-prernaalgorithmlearning
---------
Co-authored-by: Adolfo Perera <adoperera@deloitte.com>
* test: added unit tests for engine.impl.owl (#1399)
* test: added tests for auth utils (#1400)
* test: fixed tests broken on mac (#1401)
Co-authored-by: Adolfo Perera <adoperera@deloitte.com>
Co-authored-by: Ryan Weiler <ryanweiler92@gmail.com>
* 575 cache unit test (#1405)
* pushing tinker test progress
* test(unit): testing against real files in memory
* tinkerUtilitiesTests needs review
* iCache tests
* file rename
* adding test setup for IGraphUtilitiesUnitTests
* adding iGraphUtilitiesUnitTests
* adding tinkerEngineUnitTests
* adding code coverage tests for TinkerEngine
* adding test coverage for JanusEngine
* adding error message to commented out test code
* adding unit tests for CachePropFileFrameObject
* update tinkerEngine Unit tests to use tempDir
* updating tempDir for Janus tests
* adding code coverage for Icache class
* adding icache unit tests
* test(engine): fixing tests broken from dev merge
* test(cacheUtils): fixing testDeleteCache with new changes
* test(cache): testing caching insight and creating zip files
* test(cache): adding unit test for readInsightCache
* chore(tinkerUtils): removing unused imports
* test(tinker): updating tinkerEngine tests with temp folder setup
* test: removing flakey test
* test(tinker): reverting src change for filepaths in unit tests
---------
Co-authored-by: Jeff Vitunac <jvitunac@gmail.com>
Co-authored-by: Ryan Weiler <ryanweiler92@gmail.com>
* fix: checking if room is already closed to stop accessing that chat history, switching to cache builder so chat histories clear over time (#1406)
* chore: Version works for local development, remove Hashtable/Vector for ConcurrentHashMap and collections synchronizedList (#1407)
* fix: get version map info when running in local development
* chore: remove hashtable/vector for concurrenthashmap and collections synchronizedlist
* chore: removing invalid comments after refactoring
* fix: resolving codium suggestions
* feat: allowing anthropic tool streaming (#1408)
* Extra workspace features (#1388)
* fix: make sharing a one way change and only use workspace owner for permissions when workspace is not shared
* fix: get workspaces gets number of users and permission
* fix: num colabs and permission on list workspaces
* fix: add default values for private workspaces
* fix: permissions
* fix: remove comments
* fix: switch params and add project types but don't actually pass it
* fix: allow users to remove themselves from engine and project permissions table (#1404)
* fix: cleaning up projectID vs projectType filter
---------
Co-authored-by: kunal0137 <kunal0137@gmail.com>
Co-authored-by: Van Buren <tevanburen@deloitte.com>
* fix: tool json cleanup and additional _meta added (#1434)
* fix: tool json cleanup and additional _meta added
* fix: using details map within toolstep json
* fix: helper to run python methods (#1375)
* fix: workspace permissions when shared
* fix: workspace sharing
* fix: move duplicated monolith endpoint call to Security helper
* fix: workspace ownership
* fix: permission not permissions
* fix: logic error
* fix: helper to run python methods
* fix: saving progress
* fix: move existing dependencies over when shared
* fix: comment for helper
* fix: run py modules
* fix: unneeded imports
* fix: remove unused method
* fix: remove unused method
* fix: unused import
* Update SecurityProjectUtils.java
no
* Update SecurityProjectUtils.java
* Update SecurityProjectUtils.java
* fix: space instead of project
---------
Co-authored-by: kunal0137 <kunal0137@gmail.com>
Co-authored-by: rithvik-doshi <81876806+rithvik-doshi@users.noreply.github.com>
* Py reactor helper (#1437)
* fix: workspace permissions when shared
* fix: workspace sharing
* fix: move duplicated monolith endpoint call to Security helper
* fix: workspace ownership
* fix: permission not permissions
* fix: logic error
* fix: helper to run python methods
* fix: saving progress
* fix: move existing dependencies over when shared
* fix: comment for helper
* fix: run py modules
* fix: unneeded imports
* fix: remove unused method
* fix: remove unused method
* fix: unused import
* Update SecurityProjectUtils.java
no
* Update SecurityProjectUtils.java
* Update SecurityProjectUtils.java
* fix: space instead of project
* fix: unique module name
* fix: unused import
* fix: codium suggestion
* fix: codium 2
---------
Co-authored-by: kunal0137 <kunal0137@gmail.com>
Co-authored-by: rithvik-doshi <81876806+rithvik-doshi@users.noreply.github.com>
* fix: tool response coming as dict/map instead of string (#1442)
* fix: adding json loads to send / keep semoss message history with arguments as a map
* fix: sending arguments as dict, handling arguments in AskToolEngineResponse if map or string
* fix: validate user login when using basic auth (#1439)
Co-authored-by: tlokeshrao <tlokeshrao@deloitte.com>
* test: UserRegistrationEmailService Unit tests (#1443)
* 580 ds export tests (#1436)
* chore(code): removing unused imports
* test(exportGraph): adding unit tests for ds.export.graph
* refactor(ds.export): using connectionUtils to close connections
* test(ds.export): adding tests for rdbms and tinker graph exports
* test(ds.export): adding test for hasNextEdge
---------
Co-authored-by: Ryan Weiler <ryanweiler92@gmail.com>
* 592 unit test for prernaengine.imp.lfunction (#1438)
* test: adding unit tests for engine.impl.function package
* test: updated function tests after semoss update. Removed SentimentFunctionEngineUnitTests and AWSTextractFunctionEngineUnitTests.
* test: cleaning up unsused imports; completing tests for 'StreamRESTFunctionEngineUnitTests'
---------
Co-authored-by: Ryan Weiler <ryanweiler92@gmail.com>
* fix: not always adding tool_choice (#1445)
* fix: not always adding tool_choice
* fix: trimming input string once
* 1413 sec pass reset util (#1446)
* test(securityPasswordResetUtils): adding tests for securityPasswordResetUtils
* test(secPasswordReset): adding coverage tests for error messages
* test(SecurityUtils): adding test util to setup temp folder with security database setup and tear down.
---------
Co-authored-by: Ryan Weiler <ryanweiler92@gmail.com>
* feat: exposing multiple reactor utility methods, cleanup on nounstore method names (#1451)
* chore: adding multiple utility methods to make it easier to pull values from the nounstore
* chore: renaming methods in NounStore to be more clear and fixing references in other methods
* fix: cleaning up javadoc
* 571 security token utils (#1448)
* refactor(SecurityTokenUtils): using connectionUtils to close the connection
* test(SecurityTokenUtils): adding unit tests for SecurityTokenUtilsUnitTests
---------
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* fix: adding try exception for json.loads incase tools stop loading and json is not complete (#1452)
* chore: switching to utility methods (#1453)
* fix: code changes to prevent editing teams to have same type and id (#1308)
* fix: code changes to prevent editing teams to have same type and id
* fix: removed unused method and changed logic to have same group type
* fix: changes made to allow only description edit
* fix: use equals() for groupType comparison in deleteGroupAndPropagate
* chore: improved syntax for closing wrapper iterator
---------
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* feat: google calendar connectors (#1073)
---------
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* test: added SecurityUserUtils unit test class (#1449)
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* chore: adding deprecated method for some custom reactors (#1456)
* chore: adding deprecated method (#1463)
* feat: logic to predict tools outside of cot message branch; fixes for openai message building (#1464)
* feat: updating llm to use new message builders (#1354)
* feat: updating llm to use new message builders
* chore: deprecating model rest engines; feat: converting full prompt for message jsons
* fix: writing result of full prompt to db
* chore: added support for the new parameters in python.
fix: normalized the LLM response as string format when we pass tools as empty.
* feat: updating python bindings
* feat: update python usage
* feat: langchain updates
* feat: fix command param for py bindings
* feat: handle full prompt when no command or question
* fix: converting tools in full prompt from openai
* fix: adding messages as message json
---------
Co-authored-by: pasupathimuniyappan <pasupathi.muniyappan@kanini.com>
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
Co-authored-by: Ryan Weiler <ryanweiler92@gmail.com>
* feat: exposing single reactor to execute query against a database (#959)
* [#371] build: created generic sql query reactor
* [#371] fix: defaulted commit to false and added validation checks in SqlQueryReactor
* [#371] fix: add task optimization for select queries in SqlQueryReactor
* feat: get database category reactor (#371)
- limit sql query fetch to 50 rows
- create getDatabaseCategory to identify sql or noSQL db
* fix: inner reactors have their own independent noun stores, consolidating some methods
* chore: reverting back reactor factory changes
---------
Co-authored-by: Ibrahim El Nemr <70034333+ibrahimelnemr@users.noreply.github.com>
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* feat: new reactor to loop through every page of a pdf and convert to an image (#1467)
* fix: only returning the file names created (#1468)
* fix: using this_content_block instead of tool_call (#1470)
* modern way of get room options (#1469)
* fix: modern way of get room options
* fix: handle null
* fix: fix test
* Fix load module (#1462)
* fix: load module looks at right folder
* chore: adding execution insight to track which insight/user ran the command, args as Object to handle proper translation to python object syntax
* chore: adding py in appFolder init
---------
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
* feat: bedrock tool streaming, proper closing of process when socket terminates (#1471)
* fix: properly shutting off and releasing the process
* feat: exposing streaming with tools on bedrock
* test: added SecurityShareSessionUtils unit tests; fixed bug in AbstractSecurityUtilsUnitTests (#1466)
Co-authored-by: Ryan Weiler <ryanweiler92@gmail.com>
* 1412 security api user utils unit tests (#1472)
* test: created test class
* test: fixed tests, and added SecurityApiUserUtils unit tests
---------
Co-authored-by: Ryan Weiler <ryanweiler92@gmail.com>
* test: update to junit 6 (#1474)
Co-authored-by: Ryan Weiler <ryanweiler92@gmail.com>
* fix: proper validation checks in AbstractEngineFileReactor (#1475)
* fix: proper check if user is not publisher
* fix: admin only functionality check on creation of python function engine
* fix: pushing compile fixes
* feat: Added extracting selector logic
* feat: Added skip step for replay
* fix: Prompt and HTML Extraction enhancements
* fix: session utility dynamic wait time update
* moving session to user object
* fix: remove outdated reactors
* feat: handle multiple tabs
* fix: add tab id in different reactors
* feat: multiple tabs refactoring
* fix: Refactor ReplayStep and session logic to return multiple tabs actions
* fix: change timeout for clicks
* fix: return first page title in replayer
* fix: parameters
* fix: separate wait for page from click action
* Add step id + updateStep reactor
* Update StepReactor
* feat: create-MakePlaywrightMCPReactor
* feat: add AddVisionContextReactor for playwright
* feat: create-MakePlaywrightMCPReactor
* Check for password fields + don't apply step in update input
* fix: Use room.ask instead of model.ask for LLM calls
* feat: update MakePlaywrightMCPReactor
* Added session expiry logic
* Propagate session expiry error in ReplayStep
* feat: added DeleteTabReactor
Signed-off-by: RawanAbdelkhalek <rawan.abdelkhaleq@gmail.com>
* feat: added DeleteTabReactor
Signed-off-by: RawanAbdelkhalek <rawan.abdelkhaleq@gmail.com>
* feat: added GetAllSteps reactor
Signed-off-by: RawanAbdelkhalek <rawan.abdelkhaleq@gmail.com>
* fix: parent-child tab deletion handle
Signed-off-by: RawanAbdelkhalek <rawan.abdelkhaleq@gmail.com>
* feat: Support Context steps
* fix: handle context step in get all steps reactor
* feat: create ReplaySingleStepReactor
* feat:Add selector matching utility function
* Pause in case of Wait step
* refactor: :new step attributs( shouldRu,n require, description)
* fix: return coordinates and tab title
* refactor: updateStepReactor() update with required, shouldRun, desc
* init
* shared browser context for user
* Update ReplayStepReactor.java
* Update ReplayStepReactor.java
* fix: make new Step attributes nullable
* fix: apply updated step
* cleaning the code for the playwright package
* add description for the checkNetworkIdle Reactor
* update the playwright to use chromium instead of webkit
we need to run playright in chromium in the dev env
* Added roomId for generate steps reactor
* Fix initializing playwright session in user
* Create GetRoomConversationHistoryReactor.java
* fix: update ai generated steps prompt
* fix the package for the GetRoomConversationHistoryReactor
* chore: code format and renaming classes to not conflict w/ other packages
* refactor: only update step in step history - no playwright execution
* fix: update class names
---------
Signed-off-by: RawanAbdelkhalek <66391994+RawanAbdelkhalek@users.noreply.github.com>
Signed-off-by: RawanAbdelkhalek <rawan.abdelkhaleq@gmail.com>
Co-authored-by: Saleh, Anas <anassaleh1998@gmail.com>
Co-authored-by: RawanAbdelkhalek <66391994+RawanAbdelkhalek@users.noreply.github.com>
Co-authored-by: Tarek, Nada <nada.mohamed001@eng-st.cu.edu.eg>
Co-authored-by: Maryam <maryamvictor22@gmail.com>
Co-authored-by: Na-daT <nadatarek2710@gmail.com>
Co-authored-by: Pasupathi Muniyappan <pasupathi.muniyappan@kanini.com>
Co-authored-by: Ryan Weiler <ryanweiler92@gmail.com>
Co-authored-by: Maher Khalil <themaherkhalil@gmail.com>
Co-authored-by: tlokeshrao <tlokeshrao@deloitte.com>
Co-authored-by: kunal0137 <kunal0137@gmail.com>
Co-authored-by: KT Space <119169984+Varaham@users.noreply.github.com>
Co-authored-by: Varaham <katchabi50@gmail.com>
Co-authored-by: pmagudapathy <praveen.magudapathy@kanini.com>
Co-authored-by: US\pkapaleeswaran <pkapaleeswaran@deloitte.com>
Co-authored-by: Magudapathy <pmagudapathy@deloitte.com>
Co-authored-by: Subhadeepghosh1 <116416780+Subhadeepghosh1@users.noreply.github.com>
Co-authored-by: Anurag Jain <anurag91jain@gmail.com>
Co-authored-by: kaviiKS <kavimugil09@gmail.com>
Co-authored-by: kavks <Kavks@deloitte.com>
Co-authored-by: rithvik-doshi <81876806+rithvik-doshi@users.noreply.github.com>
Co-authored-by: Scott <seascott@deloitte.com>
Co-authored-by: Sneha Kumari <115411589+snehakumari369@users.noreply.github.com>
Co-authored-by: Kumari <skumari40@deloitte.com>
Co-authored-by: Van Buren <tevanburen@deloitte.com>
Co-authored-by: Rithvik Doshi <doshirithvik@gmail.com>
Co-authored-by: shines-dev <shines@deloitte.com>
Co-authored-by: resmas-tx <131498457+resmas-tx@users.noreply.github.com>
Co-authored-by: Jeff Vitunac <jvitunac@gmail.com>
Co-authored-by: Neel <neelneelneel@users.noreply.github.com>
Co-authored-by: Gyllian Zuniga <93683626+ggaylor1@users.noreply.github.com>
Co-authored-by: Adolfo Perera <adoperera@deloitte.com>
Co-authored-by: adolfo-perera <141691649+adolfo-perera@users.noreply.github.com>
Co-authored-by: roxyramos <113540659+roxyramos@users.noreply.github.com>
Co-authored-by: ericgonzal8 <ericgonzalez8@deloitte.com>
Co-authored-by: Ibrahim El Nemr <70034333+ibrahimelnemr@users.noreply.github.com>
Co-authored-by: RawanAbdelkhalek <rawan.abdelkhaleq@gmail.com>
Co-authored-by: mohamed270 <55027960+mohamed270@users.noreply.github.com>
adding parameter info into the usage section for functions