Skip to content

test: fp16 #71

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 3 commits into
base: main
Choose a base branch
from
Draft

test: fp16 #71

wants to merge 3 commits into from

Conversation

willmj
Copy link
Contributor

@willmj willmj commented Jun 27, 2025 •
edited
Loading

No description provided.

@willmj
test: fp16
6d2cd84 
Signed-off-by: Will Johnson <mwjohnson728@gmail.com>
@willmj
Copy link
Contributor Author

willmj commented Jun 27, 2025

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1,8 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1

@willmj willmj marked this pull request as ready for review June 27, 2025 22:51
@willmj
bf16
6692f98 
Signed-off-by: Will Johnson <mwjohnson728@gmail.com>
@willmj
Copy link
Contributor Author

willmj commented Jun 27, 2025

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1,8 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1

@willmj willmj marked this pull request as draft July 11, 2025 16:49
@willmj
Copy link
Contributor Author

willmj commented Jul 15, 2025

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1,8 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1

@willmj
Copy link
Contributor Author

willmj commented Jul 17, 2025

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1

@willmj willmj closed this Jul 17, 2025
@willmj
test change
9779732 
Signed-off-by: Will Johnson <mwjohnson728@gmail.com>
@willmj willmj reopened this Jul 17, 2025
@willmj
Copy link
Contributor Author

willmj commented Jul 17, 2025

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1

1 similar comment
@willmj
Copy link
Contributor Author

willmj commented Jul 17, 2025

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1

@willmj
Copy link
Contributor Author

willmj commented Jul 17, 2025

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1 AIU_TESTS_GIT_COMMIT=slack-notifications-pr-bots

@willmj
Copy link
Contributor Author

willmj commented Jul 17, 2025

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1 AIU_TESTS_GIT_COMMIT="slack-notifications-pr-bots"

3 similar comments
@willmj
Copy link
Contributor Author

willmj commented Jul 18, 2025

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1 AIU_TESTS_GIT_COMMIT="slack-notifications-pr-bots"

@willmj
Copy link
Contributor Author

willmj commented Jul 24, 2025

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1 AIU_TESTS_GIT_COMMIT="slack-notifications-pr-bots"

@willmj
Copy link
Contributor Author

willmj commented Jul 24, 2025

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1 AIU_TESTS_GIT_COMMIT="slack-notifications-pr-bots"

@willmj
Copy link
Contributor Author

willmj commented Aug 21, 2025

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1,8 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1

@willmj
Copy link
Contributor Author

willmj commented Aug 21, 2025

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1,8 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1 FMS_TEST_SHAPES_ATTN_TYPE="paged"

@willmj
Copy link
Contributor Author

willmj commented Aug 21, 2025

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1,8 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1

@willmj
Copy link
Contributor Author

willmj commented Aug 21, 2025

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1,8 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1 FMS_TEST_SHAPES_ATTN_TYPE="paged"

@willmj
Copy link
Contributor Author

willmj commented Aug 21, 2025

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1,8 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1 FMS_TEST_SHAPES_ATTN_TYPE=paged

6 similar comments
@willmj
Copy link
Contributor Author

willmj commented Aug 21, 2025

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1,8 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1 FMS_TEST_SHAPES_ATTN_TYPE=paged

@JRosenkranz
Copy link
Contributor

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1,8 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1 FMS_TEST_SHAPES_ATTN_TYPE=paged

@dpatel-ops
Copy link
Collaborator

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1,8 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1 FMS_TEST_SHAPES_ATTN_TYPE=paged

@dpatel-ops
Copy link
Collaborator

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1,8 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1 FMS_TEST_SHAPES_ATTN_TYPE=paged

@dpatel-ops
Copy link
Collaborator

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1,8 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1 FMS_TEST_SHAPES_ATTN_TYPE=paged

@dpatel-ops
Copy link
Collaborator

bot:test
TEST_FILE=test_decoders.py MODEL_ID=ibm-granite/granite-3.3-8b-instruct BATCH_SIZE=1,8 SEQUENCE_LENGTH=64 USE_TINY_MODEL=1 NUM_AIU=1 FMS_TEST_SHAPES_ATTN_TYPE=paged

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@willmj @JRosenkranz @dpatel-ops